-- Logs begin at Thu 2022-05-26 14:15:55 UTC, end at Thu 2022-05-26 15:33:07 UTC. -- May 26 14:53:28.781592 dv-cinder-843018-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 14:53:28.789349 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 14:53:28 2022] *** May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: nodename: dv-cinder-843018-3-iscsi May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: machine: x86_64 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: clock source: unix May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: pcre jit disabled May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: detected number of CPU cores: 4 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: current working directory: / May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: detected binary path: /usr/bin/uwsgi-core May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: your processes number limit is 47680 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: your memory page size is 4096 bytes May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: detected max file descriptor number: 2048 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: lock engine: pthread robust mutexes May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: thunder lock: enabled May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 14:53:28.794074 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 14:53:28.838630 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: Python main interpreter initialized at 0x55cd4c7b59c0 May 26 14:53:28.838630 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: python threads support enabled May 26 14:53:28.838630 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: your server socket listen backlog is limited to 100 connections May 26 14:53:28.838630 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: your mercy for graceful operations on workers is 90 seconds May 26 14:53:28.839051 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: mapped 403077 bytes (393 KB) for 2 cores May 26 14:53:28.839051 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: *** Operational MODE: preforking *** May 26 14:53:28.839344 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: *** uWSGI is running in multiple interpreter mode *** May 26 14:53:28.839344 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: spawned uWSGI master process (pid: 80252) May 26 14:53:28.839554 dv-cinder-843018-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 14:53:28.840976 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: spawned uWSGI worker 1 (pid: 80263, cores: 1) May 26 14:53:28.840976 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: spawned uWSGI worker 2 (pid: 80264, cores: 1) May 26 14:53:28.840976 dv-cinder-843018-3-iscsi devstack@keystone.service[80252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 14:53:34.550371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:53:34.550371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: from cryptography.utils import int_from_bytes May 26 14:53:34.551188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:53:34.551188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: from cryptography.utils import int_from_bytes May 26 14:53:34.600628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:53:34.600628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes May 26 14:53:34.601169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:53:34.601169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:53:34.601297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:53:34.601297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes May 26 14:53:34.601395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] command line args: [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:53:34.601395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:53:34.601508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ================================================================================ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:53:34.601678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] admin_token = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.601919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config_dir = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.602109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.602291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config_source = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.602472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] debug = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.602671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.603854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.603854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.603854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.604049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.604185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.604369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_config_append = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.604548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.604728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_dir = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.604907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.605144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.605400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.605650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.605900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.606081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.606260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.606506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.606755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.606990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.607248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.607485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.607718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.607966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.608214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.608491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.608977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.609161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] publish_errors = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.609396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.609626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.609807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.610052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.610287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.610521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] standard_threads = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.610751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.610996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.611201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.611380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_journal = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.611556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_json = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.611730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_stderr = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.611906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_syslog = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.612136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.612393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.612632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.612892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.613132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.613385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.613630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.613880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.614117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.614365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.614613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.614864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.615111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.615365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.615602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.615849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.616097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.616334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.616589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.616844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.617089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.617326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.617580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.617840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.618095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.618344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.618576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.619420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.619665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.619908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.620161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.620416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.620650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.620885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.621134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.621385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.621625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.621877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.622113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.622352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.622589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.622823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.623055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.623311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.623544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.623782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.624036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.624270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.624508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.624740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.624978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.625214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.625464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.625697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.625935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.626173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.626409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.626647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.626884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.627236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.627393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.627630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.627869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.628102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.628362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.628601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.628833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.629071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.629308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.629576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.629816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.630064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.630310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.630546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.630781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.631016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.631289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.631528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.631766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.632011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.632248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.632484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.632719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.632954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.633192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.633456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.633699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.633942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.634180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.634982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.635239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.635644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.635889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.636124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.636357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.636589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.636825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.637056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.637299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.637535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.637786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.638022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.638279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.638540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.638781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.639012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.external = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.639266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.639561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.639796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.640029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.password = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.640261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.token = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.640502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.640739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.640985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.641217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.641467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.641715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.641947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.642182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.642431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.642681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.642931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.643191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.643439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.643676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.643931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.644186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.644423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.644682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.644970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.645218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.645484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.645727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.645986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.646224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.646463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.646710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.646956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.647210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.647461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.647701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.647956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.648194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.648451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.648689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.648938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.649173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.649333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:53:34.649421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.649531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:53:34.649658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.649765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] command line args: [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:53:34.649979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.650760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:53:34.650942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.651221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.651401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ================================================================================ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:53:34.651492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.651562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.651684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.651814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_dir = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.651926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.652055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.652177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_source = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.652310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.652389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] debug = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.652508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.652583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.652680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.652785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.652908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.652985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.653103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.653188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.653316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.653440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.653565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.653671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.653822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.653952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_config_append = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.654030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.654146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.654232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_dir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.654327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.654406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.654560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.654639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.654803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.654893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.655036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.655190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.655302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.655435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.655516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.655643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.655721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.655838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.655914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.655985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.656110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.656216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.656342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.656464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.656575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.656698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.656807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.656948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.657027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.657198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.657285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.657435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.657527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.657684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.657764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.657932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.658164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.658252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.658404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] publish_errors = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.658480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.658618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.658698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.658847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.658928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.659024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.659146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.659296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.659377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.659528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.659616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.659767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] standard_threads = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.659846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.659996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.660075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.660239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.660333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.660679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.660757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.660829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_journal = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.660965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.661045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_json = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.661175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_stderr = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.661252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.661324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_syslog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.661452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.661538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:53:34.661690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.661779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.661926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.662972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.663913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.664919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.665818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.666880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.667856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.668955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.669985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.670937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.671901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.672975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.673942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.674864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675492 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.675953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.676991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.677945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.678858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.679859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.680963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.681043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.681262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.681347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.681525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.681780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.681969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.682932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.683987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.684913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.685996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.686972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.external = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.687986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.password = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.token = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.688914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.689937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690093 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.690889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:53:34.691765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.691993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.692259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.692511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.692747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.692998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.693278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.693530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.693793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.694036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.694294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.694530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.694769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.695017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.695301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.695533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.695782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.696018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.696271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.696508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.697283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.698029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.698290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.698530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.698781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.699032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.699299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.699537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.699786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.700017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.700255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.700511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.700761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.700993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.701225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.701456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.701700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.701946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.702192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.702446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.702694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.702962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.703226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.703464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.703695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.703932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.704162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.704395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.704634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.704870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.705128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.705359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.705605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.705850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.706083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.706329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.706575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.706805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.707043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.707299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.707536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.707773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.708015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.708252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.708488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.708737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.708984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.709215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.709446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.709694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.709943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.710182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.710417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.710651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.710880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.711137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.711399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.711634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.711882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.712128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.712385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.713642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.713892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.714138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.714472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.714786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.715192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.715454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.715712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.715965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.716218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.716469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.716705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.716957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.717198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.717437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.717674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.717912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.718158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.718406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.718644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.718898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.719148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.719397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.719632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.719867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.720104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.720358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.720600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.720833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.721068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.721308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.721555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.721800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.722035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.722284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.722532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.722834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.723118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.723212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.723361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.723443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.723590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.723675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.723867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.724115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.724347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.724596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.724845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.725092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.725339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.725583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.725828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.726073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.726318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.726546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.726792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.727037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.727310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.727554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.727959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.728678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.728936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.729187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.729436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.729685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.729919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.730173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.730431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.730682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.730915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.731177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.731412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.731664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.731921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.732167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.732335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.732431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.732623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.732853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.733088 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.733324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.733569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.733802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.734056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.734299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.734534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.734776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.735017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.735287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.735522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.735759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.736002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.736246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.736491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.736721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.736962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.737251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.737517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.737761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.738004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.738239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.738477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.738710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.738944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.739201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.739437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.739679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.739913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.740158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.740390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.740634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.740867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.741110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.741339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.741577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.741808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:53:34.741976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:53:34.761095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.761329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.767937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.768170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.768394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.779292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.798066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.798297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.814627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.836829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.865669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.865903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.875978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.876211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.932713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.932941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.933976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.934185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.934398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.957536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.957651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.957763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.957850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.957990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.958954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.970334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.970698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.982759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.983986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.984117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.984201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.984355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.984570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:34.984783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 14:53:35.002581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.002790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 14:53:35.003035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.003139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.003278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 14:53:35.003364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 14:53:35.003592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.003675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.003796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 14:53:35.003887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.004063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.004147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.004322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.004405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.004576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.004829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.016451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.016729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.016995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.017274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.017984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.018259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.018526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.018805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.025419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.027347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.028736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.029020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.029303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.029586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.029865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.030122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.030504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.030590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.030784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.030872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.031911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.032290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.032567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.032841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.033114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.033382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.059006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.060751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.061037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.061321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.063035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.063340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.066337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.066575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.066863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.068562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.068842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.069121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.074890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.075030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.077405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.077686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.079469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.079872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.080157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.080443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.080721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.080995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.081264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.081531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.082100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.082496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.082777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.083058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.083357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.083628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.083898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.084165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.100149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.100427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.103069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.103782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.105122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.108423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.108785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.109082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.112054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.112347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.114278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.117342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.117894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.121959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.122219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.122518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.122822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.123137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.123421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.123701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.125691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.125987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.126278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.126558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.126840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.127140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.143358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.143638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.143904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.144167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.146978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.147284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.147546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.147805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.152815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.154527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.154802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.156798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.157863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.158146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.158429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.158513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.158708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.158791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.158980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.162031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.162310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.162590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.162867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.163166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.173272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.173553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.173835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.174116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.174399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.174682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.174966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.177747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.178024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.178303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.178581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.178860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.179164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.179449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.193128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.196395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.198803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.200358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.201963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.202047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.203604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.203895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.204180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.205340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.206935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.208563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.208846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.209135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.211525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.213909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.217224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.217515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.217600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.217796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.218070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.219204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.222376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.222663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.222944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.223286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.227148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.227438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.227823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.232806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.233089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.233470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.235822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.236102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.236381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.236658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.236933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.237205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.237498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.237768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.238046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.238338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.238592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.238852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.239157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.240293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.241265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 14:53:35.241541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.241817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.242087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.242354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.242620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.242887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.243178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.243455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.244244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.244530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.244795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.245063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.245333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 14:53:35.279493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cd4c7b59c0 pid: 80263 (default app) May 26 14:53:35.282693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388385d-88f5-4c43-bbea-e50682c5294e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:35.282987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388385d-88f5-4c43-bbea-e50682c5294e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:35.283289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388385d-88f5-4c43-bbea-e50682c5294e None None] PATH_INFO: `/v3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:35.286620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cd4c7b59c0 pid: 80264 (default app) May 26 14:53:35.287860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Thu May 26 14:53:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:43.404831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:43.405371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:43.405371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:43.409663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:53:43.415119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:43.415546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:43.415671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:43.484180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: INFO dbcounter [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] Registered counter for database keystone May 26 14:53:43.505346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG oslo_db.sqlalchemy.engines [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:53:43.512177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writer thread running {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:53:43.690504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG passlib.handlers.bcrypt [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80263) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 14:53:43.690850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG passlib.handlers.bcrypt [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80263) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 14:53:43.747997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:43.750165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:43.885815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 14:53:44.050492 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:44.118398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: INFO dbcounter [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] Registered counter for database keystone May 26 14:53:44.137719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:53:44.143976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writer thread running {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:53:44.277892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e7f9d-d928-4162-bedc-dcd4f8704b96 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:44.282206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:44.282890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:44.283205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:44.283488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:44.292342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:44.343593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 14:53:44.343935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d4260-e7d0-42af-835c-ebb2d01f119b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:44.353464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Thu May 26 14:53:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 14:53:44.359648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:44.374118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80772f-db56-438d-8b28-000be9e487ef None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:44.378552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:44.379696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:44.379987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:44.380274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] PATH_INFO: `/v3/projects/e013887c316445b783792ef3f307427d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:44.381802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] RBAC: Authorizing `identity:get_project(project_id=e013887c316445b783792ef3f307427d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:44.544523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 14:53:44.545136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e776f3-ddb3-41e7-b5e7-8a55d5b6de1d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:44.549520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Thu May 26 14:53:44 2022] GET /identity/v3/projects/e013887c316445b783792ef3f307427d => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:46.774979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eb8c5-d92c-44c5-a3e5-e4e2b1fabe8e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:46.776078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eb8c5-d92c-44c5-a3e5-e4e2b1fabe8e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:46.776175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eb8c5-d92c-44c5-a3e5-e4e2b1fabe8e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:46.780256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:46.785810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:46.786218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:46.786373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:46.805727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:46.807582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:46.815325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 14:53:46.836988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eb8c5-d92c-44c5-a3e5-e4e2b1fabe8e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:46.849390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eb8c5-d92c-44c5-a3e5-e4e2b1fabe8e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:46.854311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba898-0fbc-4af0-959c-7502c864154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:46.854851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba898-0fbc-4af0-959c-7502c864154e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:46.855170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba898-0fbc-4af0-959c-7502c864154e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:46.855454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba898-0fbc-4af0-959c-7502c864154e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:46.863286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ba898-0fbc-4af0-959c-7502c864154e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:46.865130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ba898-0fbc-4af0-959c-7502c864154e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:46.874239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Thu May 26 14:53:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 14:53:46.879398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:46.888288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701b45a-dcd7-499f-9dc6-79ef9825094e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:46.892640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0734b7-f4c3-47e3-a2a9-f29e12669d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:46.893485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0734b7-f4c3-47e3-a2a9-f29e12669d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:46.893766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0734b7-f4c3-47e3-a2a9-f29e12669d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:46.894041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0734b7-f4c3-47e3-a2a9-f29e12669d14 admin admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:46.895430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0734b7-f4c3-47e3-a2a9-f29e12669d14 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:46.897249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0734b7-f4c3-47e3-a2a9-f29e12669d14 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:46.898790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Thu May 26 14:53:46 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:49.147038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd28b7-00d6-4a3e-8b66-83a48c16a3be None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.147583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd28b7-00d6-4a3e-8b66-83a48c16a3be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.147695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd28b7-00d6-4a3e-8b66-83a48c16a3be None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.148975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:49.154082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.154502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.154771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.171669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:49.172845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:49.211917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a2cd6-4a6b-4f53-b826-4c0c88e951b7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.212211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a2cd6-4a6b-4f53-b826-4c0c88e951b7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.212547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a2cd6-4a6b-4f53-b826-4c0c88e951b7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.213934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:53:49.219132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.219431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.219715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.255194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:49.260310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80264) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 14:53:49.260802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80264) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 14:53:49.278585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.302537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:49.308146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:49.309737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:49.388802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cd86f-8db8-4d74-b0b6-10a337ecb59a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:49.411436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:53:49.423541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:49.424347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.424981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.434424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.436668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:53:49.448561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:53:49.449807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:53:49.450761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:53:49.455520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.538290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:49.538698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8331524-7a44-4fc4-b717-61136ee716b7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:49.541120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:49.558211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b35983-86df-430e-9e7a-ac145c795178 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:49.576082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:49.576993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.577282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.577564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.592477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:49.593142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.593426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.593705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.594452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:49.594760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:49.596199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:49.608688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:49.614198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.644762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:49.646289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:49.713623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab438-bde1-4e8f-9bfd-b4ca6ef9afd8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:49.745938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 14:53:49.749643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:49.750516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.750796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.751074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.751409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.752298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:49.753793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:49.754196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:49.755482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:49.761223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.776621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:49.850700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956cff-7fbb-40c9-bed0-65841808e0bf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:49.862727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165af10-a55b-40d9-8fb3-570baf078bbf None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:49.887435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:49.888300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.888624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.888924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.896781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:49.897566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:49.897908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:49.898185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:49.899394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:49.901538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:49.903677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:49.909671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.910625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:49.913480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:53:49.939330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:53:49.940333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:53:49.941283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:53:49.941283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:53:49.941283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:53:49.941283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:53:49.941283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:53:49.946284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:49.996345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:50.003588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:50.016851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711190d6-72c8-4952-b4b6-a46ddc938a2d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:50.052596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8cf2-0b40-4b57-91ee-e293cbe66264 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:50.052954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:50.053616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:50.053906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:50.054193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:50.055024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.domain.id=default, user.id=6cc1f206a7534d478df8987147a33502) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:50.055367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:50.057205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ef621-ffe6-4a67-8328-2de6eac4bd30 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:50.064147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/role_assignments?user.id=6cc1f206a7534d478df8987147a33502&scope.domain.id=default&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:50.089891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:50.090692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:50.090971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:50.091281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:50.092030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:50.092337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:50.093771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ac09-0823-4277-ae38-4c56075b74bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:50.115569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:52.678044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2e0c-c8cd-48d7-a581-e406c3b958ae None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:52.678944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2e0c-c8cd-48d7-a581-e406c3b958ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:52.679397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2e0c-c8cd-48d7-a581-e406c3b958ae None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:52.681231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:52.686958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50a20-78e7-4649-be48-0c9509f8c0c6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:52.687733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50a20-78e7-4649-be48-0c9509f8c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:52.688176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50a20-78e7-4649-be48-0c9509f8c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:52.828751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-36c50a20-78e7-4649-be48-0c9509f8c0c6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:52.830178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36c50a20-78e7-4649-be48-0c9509f8c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:52.909956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 11/23] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:53:52.939168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2e0c-c8cd-48d7-a581-e406c3b958ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:52.954001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e73d37-50c4-462f-849f-16079cfd0712 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:52.954509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e73d37-50c4-462f-849f-16079cfd0712 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:52.954952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e73d37-50c4-462f-849f-16079cfd0712 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:52.958661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:52.963353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812e89b-30f7-4b79-a484-e58acc70dfa2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:52.963843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812e89b-30f7-4b79-a484-e58acc70dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:52.964345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812e89b-30f7-4b79-a484-e58acc70dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:52.992298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1812e89b-30f7-4b79-a484-e58acc70dfa2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:52.997177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1812e89b-30f7-4b79-a484-e58acc70dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:53.084692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:53.130969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2e0c-c8cd-48d7-a581-e406c3b958ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:53.145120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:53.146711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726ff6-0235-4c13-821c-a5ad0fbdd5a5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.147173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726ff6-0235-4c13-821c-a5ad0fbdd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.151183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726ff6-0235-4c13-821c-a5ad0fbdd5a5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.152674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:53.169193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.169685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.170135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.182441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:53.187520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.187964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.188388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.204081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:53:53.208113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:53.209428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:53:53.212594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:53:53.213747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:53:53.214676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:53:53.221880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:53:53.222823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:53.227694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:53.333024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab23ad-3786-4977-b63a-7adfefdc3d4c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:53.350760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 15/28] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:53.351429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:53.412481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:53.413158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.413444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.413719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.414473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:53.416664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:53.574325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ee137-be99-402a-bbf5-6fb932242b37 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:53.578256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 14/29] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 14:53:53 2022] POST /identity/v3/roles => generated 219 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:53:53.579186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:53.590326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:53.659695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:53.660667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.660950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.661224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.662087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:53.662398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:53.665107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:53.709319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 16/30] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:53.716612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:53.753283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:53.810385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125ce8-5845-4d84-a4fd-793264acf3f4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:53.853933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:53.855273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.855743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.856199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.871336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:53.873727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:53.876057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8a904-5ad5-4c0f-9e0e-8ab0d56feb9e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fb122c63-c87c-43dc-be08-b93781628244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:53:53.895743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:53:53.896596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:53:53.897375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:53:53.897375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:53:53.897375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:53:53.897375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:53:53.899563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 15/31] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:53:53.901377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b55d1-85ed-4d00-a82c-c22756968add None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.901838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b55d1-85ed-4d00-a82c-c22756968add None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.902280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b55d1-85ed-4d00-a82c-c22756968add None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.903942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 16/32] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:53.905172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b55d1-85ed-4d00-a82c-c22756968add None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:53.928255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20d72a-f73b-4c36-a810-d0d1ccad5ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:53.929316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d72a-f73b-4c36-a810-d0d1ccad5ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.929632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d72a-f73b-4c36-a810-d0d1ccad5ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.929985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d72a-f73b-4c36-a810-d0d1ccad5ad4 None admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.932437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20d72a-f73b-4c36-a810-d0d1ccad5ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:53.934205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20d72a-f73b-4c36-a810-d0d1ccad5ad4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:53.937301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 17/33] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:53:53 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:53.938664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:53.939059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:53.939480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:53.971298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:53.972658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:54.013508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:54.044304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b55d1-85ed-4d00-a82c-c22756968add None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.068924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:54.090840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 18/34] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:54.092365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:54.092623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.093367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.093664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.093954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.094764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:54.095105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.098221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.120634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 17/35] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:54.126183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:54.202229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c32360-4bd6-428a-95de-3df703be6e5a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.238680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.239635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.239958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.240218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.241394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.242159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a851a-9877-4c6b-b065-cb5b7f762c2f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.242845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.245052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 19/36] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:54.245786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:54.282706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:54.288360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebf240-99ed-4e95-81dd-6f7e7d3db6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.289040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebf240-99ed-4e95-81dd-6f7e7d3db6dd None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.289335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebf240-99ed-4e95-81dd-6f7e7d3db6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.289629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebf240-99ed-4e95-81dd-6f7e7d3db6dd None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.290350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebf240-99ed-4e95-81dd-6f7e7d3db6dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.292453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebf240-99ed-4e95-81dd-6f7e7d3db6dd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.322378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:53:54 2022] POST /identity/v3/projects => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:53:54.328691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddeac6-de77-4363-9856-f6d143bd0e31 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.329002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddeac6-de77-4363-9856-f6d143bd0e31 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.329257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddeac6-de77-4363-9856-f6d143bd0e31 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.330643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 19/38] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:54.339574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddeac6-de77-4363-9856-f6d143bd0e31 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:54.373416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8875f-82df-4a2d-aa42-9a65037876f6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.375599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:54.415182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ffaf-d781-42ab-8705-c5aa735c0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.416996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ffaf-d781-42ab-8705-c5aa735c0508 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.417255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ffaf-d781-42ab-8705-c5aa735c0508 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.417499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ffaf-d781-42ab-8705-c5aa735c0508 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.418267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ffaf-d781-42ab-8705-c5aa735c0508 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.419695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ffaf-d781-42ab-8705-c5aa735c0508 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.464279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddeac6-de77-4363-9856-f6d143bd0e31 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.501732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64255-caa0-45d5-b66c-6d0a93917f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.502615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64255-caa0-45d5-b66c-6d0a93917f88 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.502898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64255-caa0-45d5-b66c-6d0a93917f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.503260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64255-caa0-45d5-b66c-6d0a93917f88 None admin] PATH_INFO: `/v3/domains/default/users/6cc1f206a7534d478df8987147a33502/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.505282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64255-caa0-45d5-b66c-6d0a93917f88 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6cc1f206a7534d478df8987147a33502, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.506759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64255-caa0-45d5-b66c-6d0a93917f88 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.522978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1361 bytes} [Thu May 26 14:53:54 2022] PUT /identity/v3/domains/default/users/6cc1f206a7534d478df8987147a33502/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:53:54.524271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.524565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.524869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.545003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:54.546628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:54.567795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 14:53:54 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:53:54.569386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e2e19-96b1-49b6-9804-498a79f7651c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.569683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e2e19-96b1-49b6-9804-498a79f7651c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.569967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e2e19-96b1-49b6-9804-498a79f7651c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.571955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 21/41] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:54.580089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.580389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.580679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.616445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:54.618061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:54.642740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 21/42] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:54.666922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:54.698446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:54.711371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 22/43] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:54.734687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:54.772976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:54.815350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68868a-7904-4632-a91d-abb16032ae10 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.863918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.864613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.864909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.865189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.865955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.867435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.877620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdd2e-9a71-4864-8d87-eab9ea3f9c00 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:54.883576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 14:53:54 2022] POST /identity/v3/roles => generated 223 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:53:54.928637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58efda-033b-4123-b131-1c672f8ded47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:54.929463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58efda-033b-4123-b131-1c672f8ded47 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:54.929756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58efda-033b-4123-b131-1c672f8ded47 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:54.930041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58efda-033b-4123-b131-1c672f8ded47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:54.932079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58efda-033b-4123-b131-1c672f8ded47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:54.933812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58efda-033b-4123-b131-1c672f8ded47 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:54.935962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 23/45] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:54.941426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:55.033863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:55.064193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b00ed-fe14-486d-8183-5f9929315818 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:55.101752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7e9eb-1bfa-41fa-8148-74012d428db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:55.102429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7e9eb-1bfa-41fa-8148-74012d428db7 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:55.102719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7e9eb-1bfa-41fa-8148-74012d428db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:55.103052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7e9eb-1bfa-41fa-8148-74012d428db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:55.103822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7e9eb-1bfa-41fa-8148-74012d428db7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:55.105289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7e9eb-1bfa-41fa-8148-74012d428db7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:55.133558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:53:54 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:53:56.832735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeec26-cc17-48d9-b883-58db37be3fbd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:56.833254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeec26-cc17-48d9-b883-58db37be3fbd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:56.833370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeec26-cc17-48d9-b883-58db37be3fbd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:56.834770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 24/47] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:53:56.840783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:56.841204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:56.841362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:56.858523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:56.859751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:56.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:53:56.948124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeec26-cc17-48d9-b883-58db37be3fbd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.042999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:57.052841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeec26-cc17-48d9-b883-58db37be3fbd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.086632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.087983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.088427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.088721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.099981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:53:57.108933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:53:57.109782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:53:57.110543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 25/49] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:53:57.116061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.174837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:57.217511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcdab8-d7e1-4b74-8b71-bc272576ed29 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.251274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.251950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.252244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.252529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.253318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:57.253632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:57.255073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:57.263985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 25/50] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:57.269535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.373495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4a70-109a-4fa2-b0cc-149e377d39e4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.408764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f14f6-b818-459f-92d6-bf36603f7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.409656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f14f6-b818-459f-92d6-bf36603f7a8d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.409948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f14f6-b818-459f-92d6-bf36603f7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.410493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f14f6-b818-459f-92d6-bf36603f7a8d None admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.411715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f14f6-b818-459f-92d6-bf36603f7a8d None admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:57.413181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f14f6-b818-459f-92d6-bf36603f7a8d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:57.414821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 26/51] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:53:57 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:57.420352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.519251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0918-11c8-4263-aa4f-2001e7b81f68 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.542126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:57.548048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c503-76a4-425c-aae5-0a5e6800f852 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.548344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c503-76a4-425c-aae5-0a5e6800f852 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.548631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c503-76a4-425c-aae5-0a5e6800f852 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.550023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 27/52] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:53:57.554325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.554803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.555127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.555224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.555417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.555518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.555705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.557099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:57.558594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:57.560453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:53:57.565796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.572519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:53:57.573729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:53:57.589004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:57.641584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 28/54] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:53:57.665227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.667161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887603-cb17-49a3-89db-d5de36487d09 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.700816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.701472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.701765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.702047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.702892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.domain.id=default, user.id=6cc1f206a7534d478df8987147a33502) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:53:57.703242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:57.704726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:57.710550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1322 bytes} [Thu May 26 14:53:57 2022] GET /identity/v3/role_assignments?user.id=6cc1f206a7534d478df8987147a33502&scope.domain.id=default&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:57.768987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65308ea8-b6dd-43ba-86dd-36ac9fea35af None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.805479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054af6f-7aab-424c-ac6a-9366f63b9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.806395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054af6f-7aab-424c-ac6a-9366f63b9d42 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.806678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054af6f-7aab-424c-ac6a-9366f63b9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.807007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054af6f-7aab-424c-ac6a-9366f63b9d42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.808207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054af6f-7aab-424c-ac6a-9366f63b9d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:57.809704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054af6f-7aab-424c-ac6a-9366f63b9d42 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:57.811457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 29/56] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:53:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:53:57.817080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:53:57.879343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:53:57.926142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19309814-d9b6-4f82-9870-1ca66bc2e672 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:53:57.961802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4648-b967-412f-9a0c-daa5caf333f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:53:57.963299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4648-b967-412f-9a0c-daa5caf333f2 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:53:57.963597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4648-b967-412f-9a0c-daa5caf333f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:53:57.963910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4648-b967-412f-9a0c-daa5caf333f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:53:57.964642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4648-b967-412f-9a0c-daa5caf333f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:53:57.966118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4648-b967-412f-9a0c-daa5caf333f2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:53:57.991517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 28/57] 10.222.0.45 () {60 vars in 1140 bytes} [Thu May 26 14:53:57 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:00.286851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c86b1-f6b3-4381-a08c-a97d4487a2fb None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:00.287437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c86b1-f6b3-4381-a08c-a97d4487a2fb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:00.287437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c86b1-f6b3-4381-a08c-a97d4487a2fb None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:00.288811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:00.294393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:00.294836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:00.294938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:00.311836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:00.313010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:00.378447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:00.402922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c86b1-f6b3-4381-a08c-a97d4487a2fb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:00.422068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:00.503049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c86b1-f6b3-4381-a08c-a97d4487a2fb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:00.537278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1229762-1512-4a5f-925b-41c58fdb529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:00.538069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1229762-1512-4a5f-925b-41c58fdb529a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:00.538362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1229762-1512-4a5f-925b-41c58fdb529a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:00.538646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1229762-1512-4a5f-925b-41c58fdb529a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:00.539845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1229762-1512-4a5f-925b-41c58fdb529a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:00.541494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1229762-1512-4a5f-925b-41c58fdb529a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:00.543132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 31/60] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:00.548666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:00.583050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:00.647838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d453cf-28cb-4a2a-974d-ef04e1e4d331 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:00.685371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7625f-7afc-4cf8-8171-72af6ee4d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:00.686058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7625f-7afc-4cf8-8171-72af6ee4d97f None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:00.686351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7625f-7afc-4cf8-8171-72af6ee4d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:00.686637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7625f-7afc-4cf8-8171-72af6ee4d97f None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:00.687405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7625f-7afc-4cf8-8171-72af6ee4d97f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:00.688904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7625f-7afc-4cf8-8171-72af6ee4d97f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:00.717211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 30/61] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:00 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:04.069880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12cdb-0e99-4bc1-b69a-24436448e3ac None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.070848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12cdb-0e99-4bc1-b69a-24436448e3ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.072280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12cdb-0e99-4bc1-b69a-24436448e3ac None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.074241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 32/62] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:04.080171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3397b7-06d7-4c60-8cc7-d8c1b5a49aba None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.081156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3397b7-06d7-4c60-8cc7-d8c1b5a49aba None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.081650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3397b7-06d7-4c60-8cc7-d8c1b5a49aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.108141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ce3397b7-06d7-4c60-8cc7-d8c1b5a49aba None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:04.109690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce3397b7-06d7-4c60-8cc7-d8c1b5a49aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:04.205403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 31/63] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:04.240454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12cdb-0e99-4bc1-b69a-24436448e3ac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.263186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c04ccd-9125-48b3-96bb-65bd32ce0c0b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.263822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c04ccd-9125-48b3-96bb-65bd32ce0c0b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.264332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c04ccd-9125-48b3-96bb-65bd32ce0c0b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.265955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 32/64] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:04.271387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61004a5-cca9-4a04-be60-4e24192a5460 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.271947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61004a5-cca9-4a04-be60-4e24192a5460 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.272446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61004a5-cca9-4a04-be60-4e24192a5460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.299786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a61004a5-cca9-4a04-be60-4e24192a5460 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:04.301226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a61004a5-cca9-4a04-be60-4e24192a5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:04.321315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:04.367384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:04.388052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12cdb-0e99-4bc1-b69a-24436448e3ac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:04.389601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 33/65] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:04.391373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc1904-51d5-48a3-b08b-e2bebd5745ad None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.391923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc1904-51d5-48a3-b08b-e2bebd5745ad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.392333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc1904-51d5-48a3-b08b-e2bebd5745ad None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.393732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 34/66] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:04.402901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.403397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.403845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.436773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:04.438403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:04.438585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:04.439599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.440058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.440487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.455267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:04.466729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:04.467911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:04.468872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:04.471987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 33/67] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:04.473065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.536109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 35/68] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:04.537380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.613495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75588e75-cb48-4493-8221-04ea42c01cca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:04.639563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:04.657173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:04.658513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.658954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.659409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.659603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24472e-307b-4097-9d49-f99d7cb9dbd0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:04.674818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:04.686593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:04.687526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:04.688287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:04.689757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:04.689757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.701966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:04.706328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:04.707127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.707354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.707818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.708594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:04.708915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:04.710347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:04.719641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 36/70] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:04.724291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.803446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ac853-9fa3-402b-8247-a5dc5cff6e54 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:04.832254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac1806-88db-44d9-a1f6-e666b9f8815b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:04.837641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb3ef5-1cbb-41e3-931b-3d6808d5950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:04.838466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb3ef5-1cbb-41e3-931b-3d6808d5950a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.838755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb3ef5-1cbb-41e3-931b-3d6808d5950a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.839039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb3ef5-1cbb-41e3-931b-3d6808d5950a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.849373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb3ef5-1cbb-41e3-931b-3d6808d5950a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-16cb3ef5-1cbb-41e3-931b-3d6808d5950a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:04.858220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:04.859108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:04.859888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:04.862228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbf244-6315-408c-93f7-19308ee08df8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.862628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbf244-6315-408c-93f7-19308ee08df8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.862921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbf244-6315-408c-93f7-19308ee08df8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.864329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 36/72] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:04.864977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbf244-6315-408c-93f7-19308ee08df8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.868786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:04.870246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.870542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.870824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.871633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:04.871950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:04.873349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823d864-c016-4919-9574-282fecbfc370 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:04.881842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:04.883059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef0a2-2ff8-4640-a894-df39ce0ee281 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:04.883404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef0a2-2ff8-4640-a894-df39ce0ee281 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:04.883689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef0a2-2ff8-4640-a894-df39ce0ee281 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:04.887615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 38/74] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:04.887615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef0a2-2ff8-4640-a894-df39ce0ee281 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:04.896700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:04.932351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:04.968847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbf244-6315-408c-93f7-19308ee08df8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:04.991629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef0a2-2ff8-4640-a894-df39ce0ee281 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.007430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f624bf-cfb1-4251-a212-5de638379e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.008352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624bf-cfb1-4251-a212-5de638379e45 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.008649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624bf-cfb1-4251-a212-5de638379e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.009023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f624bf-cfb1-4251-a212-5de638379e45 None admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.010230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f624bf-cfb1-4251-a212-5de638379e45 None admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.011736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f624bf-cfb1-4251-a212-5de638379e45 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.013378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:05.014528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed798-9037-4eaf-955f-8273e608c19c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.014819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed798-9037-4eaf-955f-8273e608c19c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.015116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed798-9037-4eaf-955f-8273e608c19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.030045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.030726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.031015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.031329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.031796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-693ed798-9037-4eaf-955f-8273e608c19c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:05.032088 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:05.032402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.032996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-693ed798-9037-4eaf-955f-8273e608c19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:05.033813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.045589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 39/76] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:05.046418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.107283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 38/77] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:05.115879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.117023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.117502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.117968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.136370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:05.137561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:05.150500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa544-aa4a-4121-8c50-d3794febc36f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.184313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.185187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.185481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.185770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.198572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.200392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.201905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.203773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 40/78] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:05.204393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.211438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 39/79] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:05.212930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.305277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcaf4-ff40-4fc9-8e4f-43b4aa4dc0f3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.314903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288e635-4893-4dca-9ec2-3fd68455923d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.334577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.343940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.344601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.344895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.345182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.349457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.350336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.350625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.350907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.352154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.354296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.355957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 40/80] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:05.356727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.418537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.418693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.420006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.457909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f137-066e-4f40-9a95-559115c29726 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.491801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.492599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.492892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.493176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.503908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:05.511791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:05.512763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:05.513508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 41/81] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:05.514384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.524016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 41/82] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:05.526140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.554420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.617557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8af5-de36-49dc-a946-046a80d23365 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.628248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb12d8f-60c4-4c1c-ab7a-128cf669ec55 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.640567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.654259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.654906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.655223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.655510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.664436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.665798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.666111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.666396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.667682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.669218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.675390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 42/83] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:05.675390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.725156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.726641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.764617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.772081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7473-0b98-4018-af45-505adcfc6bfe None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.808133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.808786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.809075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.809361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.827417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 42/84] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:05.828268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.851656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.881697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.883385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.928988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e61d73-1510-436d-9030-3d0e961ea7d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:05.963071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:05.963761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:05.964044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:05.964329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:05.965065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:05.965370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:05.966742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:05.974638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 43/85] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:05.975575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:05.980560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:05.983878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 43/86] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:05.984734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.076778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:06.089629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc989-6ec8-4cff-a30b-5292f3575669 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.094728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233144-36ef-49a4-83f9-379a2058bc74 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.124358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.125039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.125332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.125618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.126331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.127845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.128140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.129020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.129309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.129590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.130792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.132271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.139370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 44/87] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:05 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:06.139370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.161945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 44/88] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:05 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:06.161945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.228700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:06.271828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f242d-fb5d-4eef-905f-cf2163a5b068 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.294222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2ccc-da21-44f5-b293-a984cef83c57 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.312215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.313172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.313504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.313828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.315225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.316871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.318859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 45/89] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:06.319802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.343791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.344744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.344988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.345278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.346498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.348055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.350704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 45/90] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:06.350704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.352535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:06.455603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40fe0c-ce56-4faa-90b3-2160e090dc31 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.477359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632b71-b38a-4270-b4cb-db13c68f85a4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.497141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:06.497299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.498139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.498435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.498721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.500890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.502451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.504265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 46/91] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:06.505068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.517617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.518704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.519072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.519466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.520397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=6cc1f206a7534d478df8987147a33502) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:06.520719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.522191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.530847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 46/92] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/role_assignments?user.id=6cc1f206a7534d478df8987147a33502&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:06.531751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.683118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:06.683752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b4700-d784-40d2-9357-159b8ac377cd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.685722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d365a-fc2b-443e-9656-2a8dbdab0d82 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.754322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.755010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.755331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.755549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:06.755663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.756229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:06.756520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:06.756805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:06.757668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=4341a8c3a5294dcfa0689edce871eeb0) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:06.757986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.761550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:06.771742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 47/93] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/role_assignments?user.id=4341a8c3a5294dcfa0689edce871eeb0&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:06.772742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:06.897896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e2bd8-12e6-4834-a1d8-6e88b0b4da68 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:06.899447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:06.933869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:06.935809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:07.019897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:07.020590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:07.020883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:07.021172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:07.022039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] RBAC: Adding query filter params (role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=4341a8c3a5294dcfa0689edce871eeb0) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:07.022362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:07.023942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:07.044955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 48/94] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/role_assignments?user.id=4341a8c3a5294dcfa0689edce871eeb0&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:07.067455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 47/95] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:07.073231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:07.102444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:07.217703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3710c5-f23e-47a7-a7a5-27626ab60ea2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:07.265134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04e66-b795-4034-b178-eb08a27d7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:07.265134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04e66-b795-4034-b178-eb08a27d7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:07.265134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04e66-b795-4034-b178-eb08a27d7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:07.265134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04e66-b795-4034-b178-eb08a27d7ec8 None admin] PATH_INFO: `/v3/projects/5defe554fef440a6942f2d764958739e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:07.265923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f04e66-b795-4034-b178-eb08a27d7ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=5defe554fef440a6942f2d764958739e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:07.267473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f04e66-b795-4034-b178-eb08a27d7ec8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:07.269471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 49/96] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:07 2022] GET /identity/v3/projects/5defe554fef440a6942f2d764958739e => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:07.275704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:07.388251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:07.414487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581f822-e173-44f9-8180-9ab6977510d8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:07.459825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:07.460518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:07.460814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:07.461100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:07.461959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=5defe554fef440a6942f2d764958739e, user.id=4341a8c3a5294dcfa0689edce871eeb0) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:07.463057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:07.464653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ddbd5-7ffb-4851-8669-4f88ad1e11dd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:07.470868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 48/97] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:07 2022] GET /identity/v3/role_assignments?user.id=4341a8c3a5294dcfa0689edce871eeb0&scope.project.id=5defe554fef440a6942f2d764958739e&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:09.384749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6538-fde7-4649-b22a-c67179e7d2a9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.385829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6538-fde7-4649-b22a-c67179e7d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.386385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6538-fde7-4649-b22a-c67179e7d2a9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.388171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 50/98] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:09.401072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f8d09-5965-48bd-bce3-d8b7f164cb80 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.402130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f8d09-5965-48bd-bce3-d8b7f164cb80 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.402669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f8d09-5965-48bd-bce3-d8b7f164cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.432618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c26f8d09-5965-48bd-bce3-d8b7f164cb80 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:09.434282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c26f8d09-5965-48bd-bce3-d8b7f164cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:09.526878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 49/99] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:09.563789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6538-fde7-4649-b22a-c67179e7d2a9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:09.626597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf687f-a8ca-4d29-b651-4f786e576708 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.627312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf687f-a8ca-4d29-b651-4f786e576708 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.627813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf687f-a8ca-4d29-b651-4f786e576708 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.629398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 50/100] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:09.635295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebe81-11a5-4487-8c04-8726dfb60d28 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.635884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebe81-11a5-4487-8c04-8726dfb60d28 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.636363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebe81-11a5-4487-8c04-8726dfb60d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.655261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c1aebe81-11a5-4487-8c04-8726dfb60d28 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:09.656759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c1aebe81-11a5-4487-8c04-8726dfb60d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:09.695635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:09.744891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6538-fde7-4649-b22a-c67179e7d2a9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:09.827463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 51/101] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:09.839904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26530847-3d59-42d6-a389-d795b20fa1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:09.841168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530847-3d59-42d6-a389-d795b20fa1cf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.841675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530847-3d59-42d6-a389-d795b20fa1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.842166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530847-3d59-42d6-a389-d795b20fa1cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.860108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530847-3d59-42d6-a389-d795b20fa1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:09.864211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8812c8-c000-462f-898b-c48168636c11 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.864756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8812c8-c000-462f-898b-c48168636c11 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.865251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8812c8-c000-462f-898b-c48168636c11 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.867199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 52/102] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:09.868234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8812c8-c000-462f-898b-c48168636c11 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-26530847-3d59-42d6-a389-d795b20fa1cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:09.873546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:09.874428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 51/103] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:09.875259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:09.875968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:09.875968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:09.891576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:09.918362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:09.919605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:10.081936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8812c8-c000-462f-898b-c48168636c11 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.094786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 52/104] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 14:54:10.095926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.123693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.124916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.125440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.125929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.139846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:10.148417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:10.149310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:10.150148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:10.152590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 53/105] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:10.160353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.231468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:10.275265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc986c9-8c6f-481e-9e57-791daf0eef38 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.290181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:10.317853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cde1d-38a3-48a5-85f5-7425cbf0fcbb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.326062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.328148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.328615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.329053 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.334954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.336482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:10.338633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 54/106] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:10.339444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.367714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.369084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.369443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.369731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.370490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:10.370800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.372234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f19e-8e0a-437e-afab-3530006af3d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:10.381102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 53/107] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:10.382435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068cd8-6cb3-4a6e-b011-6facd354f3b3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.382734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068cd8-6cb3-4a6e-b011-6facd354f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.383018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068cd8-6cb3-4a6e-b011-6facd354f3b3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.384923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 54/108] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:10.385648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068cd8-6cb3-4a6e-b011-6facd354f3b3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.450701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f00be7-24b8-4420-ba2a-d2687beca6a6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.487814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.488501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.488802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.489087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.489853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:10.490169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.491696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:10.493072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:10.499151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068cd8-6cb3-4a6e-b011-6facd354f3b3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.502555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 55/109] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:10.503429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.536418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98c588-a3ab-43b1-b2a0-2b24c73865a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.537097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98c588-a3ab-43b1-b2a0-2b24c73865a5 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.537387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98c588-a3ab-43b1-b2a0-2b24c73865a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.537671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98c588-a3ab-43b1-b2a0-2b24c73865a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.538387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98c588-a3ab-43b1-b2a0-2b24c73865a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.540795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98c588-a3ab-43b1-b2a0-2b24c73865a5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:10.545766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:10.575470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 55/110] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:54:10 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:10.584005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a79050-edd3-485c-832c-03cc0b8a6b1c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.584331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a79050-edd3-485c-832c-03cc0b8a6b1c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.584583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a79050-edd3-485c-832c-03cc0b8a6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.613702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-61a79050-edd3-485c-832c-03cc0b8a6b1c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:10.615006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61a79050-edd3-485c-832c-03cc0b8a6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:10.617480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16424da-525f-42b8-a1dc-a097c66a62aa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.656656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.657654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.657843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.658128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] PATH_INFO: `/v3/users/e616c37c599b40659f18b5ba4c8c195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.674826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] RBAC: Authorizing `identity:get_user(user_id=e616c37c599b40659f18b5ba4c8c195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.676435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:10.678567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 56/111] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/users/e616c37c599b40659f18b5ba4c8c195f => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:10.679428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.699725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 56/112] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:10.701345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377867e-4dc4-42f0-ae0b-3497295a4039 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.701584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377867e-4dc4-42f0-ae0b-3497295a4039 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.701875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377867e-4dc4-42f0-ae0b-3497295a4039 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.703311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 57/113] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:10.704223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377867e-4dc4-42f0-ae0b-3497295a4039 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.741992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:10.795925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8fbf-bc56-493d-9dcf-5f4d9aae9128 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.833625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f422d-7658-4aec-9de7-e301163c2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.833832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377867e-4dc4-42f0-ae0b-3497295a4039 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:10.834514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f422d-7658-4aec-9de7-e301163c2e72 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.835381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f422d-7658-4aec-9de7-e301163c2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.837811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f422d-7658-4aec-9de7-e301163c2e72 None admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.837921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f422d-7658-4aec-9de7-e301163c2e72 None admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.839378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f422d-7658-4aec-9de7-e301163c2e72 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:10.841062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 57/114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:10.842267 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.842556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.842840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.855890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:10.860635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:10.861800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:10.875222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378ba9-518f-4713-95e1-cb06ce8c7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:10.875887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378ba9-518f-4713-95e1-cb06ce8c7f02 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:10.876178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378ba9-518f-4713-95e1-cb06ce8c7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:10.876552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378ba9-518f-4713-95e1-cb06ce8c7f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:10.938663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 58/115] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:10.940399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:10.953046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378ba9-518f-4713-95e1-cb06ce8c7f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:10.954745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378ba9-518f-4713-95e1-cb06ce8c7f02 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.001543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.058246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70d37a-60e6-4603-b125-3a9d35b3b58f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.081236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 58/116] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:11.081236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cde2-aacc-405c-b649-d321a6f42fa0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.081236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cde2-aacc-405c-b649-d321a6f42fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.081236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cde2-aacc-405c-b649-d321a6f42fa0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.081236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 59/117] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:11.081670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cde2-aacc-405c-b649-d321a6f42fa0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.094217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.095028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.095354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.095730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.106803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:11.107605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:11.115328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:11.116201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:11.116947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 59/118] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:11.123495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.205399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cde2-aacc-405c-b649-d321a6f42fa0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.235663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2342575-b67e-4e48-b3cf-6361ecce4118 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.241902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.242779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.243072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.244110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.245391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.246855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.248611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 60/119] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:11.249385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.256499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.279480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5272f-eaf7-4275-88ef-beaffa138485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.280285 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5272f-eaf7-4275-88ef-beaffa138485 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.280763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5272f-eaf7-4275-88ef-beaffa138485 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.280886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5272f-eaf7-4275-88ef-beaffa138485 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.292598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5272f-eaf7-4275-88ef-beaffa138485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-62d5272f-eaf7-4275-88ef-beaffa138485 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:11.300537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:11.301558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:11.302323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 60/120] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:11.302969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.303478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.303478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.321625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:11.322896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:11.350839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.368958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2e169-65ab-4693-9791-04ce6462f3b2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.398771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 61/121] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:11.400627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.416399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.418639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.419190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.419931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.421914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.423403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.425964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 61/122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:11.426971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.510584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bb7cd-d69c-43a2-a983-c0d9e8139fb3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.512127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.546912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0842f-b19d-464f-9faf-94f8e38d6f1d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.547260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.547913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.548201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.548487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.549886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:11.549886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.550946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.564135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 62/123] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:11.564135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.585853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.587570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.587887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.588170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d/users/6cc1f206a7534d478df8987147a33502/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.590244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=22d60acff64648e686937b1039fe715d, user_id=6cc1f206a7534d478df8987147a33502, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.591861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.606575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 62/124] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:11 2022] PUT /identity/v3/projects/22d60acff64648e686937b1039fe715d/users/6cc1f206a7534d478df8987147a33502/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:11.611365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.626503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.708805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc99f8-ed53-4954-a03b-b138b26e8a4d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.739383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373a95c-ec46-454a-8028-fc11296d3ec8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.748980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.750146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.750707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.751264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.752384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:11.752914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.754648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.766750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 63/125] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:11.768145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.783814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.784656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.784954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.785619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.798883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:11.803581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:11.810507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:11.811655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 63/126] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:11.812686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.890714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f378309-4b9e-4420-afa4-552cce42c0e5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.907500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:11.929422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.930098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.930389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.930707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.931626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] RBAC: Adding query filter params (role.id=72e9940f6d44456c9aa6261eb83d0c54, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=e616c37c599b40659f18b5ba4c8c195f) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:11.931949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.933456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.934774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99a76-8098-41b9-a93f-c2c8db59f69b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:11.947816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 64/127] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/role_assignments?user.id=e616c37c599b40659f18b5ba4c8c195f&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=72e9940f6d44456c9aa6261eb83d0c54 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:11.948444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:11.980144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:11.981435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:11.981942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:11.982438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:11.984019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:11.986455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:11.988481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 64/128] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:11.989918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.092237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:12.108466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a28b9-443d-4e1b-9d86-aa6d9bbbfc0a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.139335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e81d9-b507-4369-b373-3495783ebb59 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.162463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.164384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.164915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.166870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.168715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.171201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.174471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 65/129] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:12.175729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.188091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.188916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.189280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.189640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.191203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:12.191203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.192510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.203021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 65/130] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:12.204078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.213358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:12.303267 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c89177-a2e8-4f67-956b-81c25df118a1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.342817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.344062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.344557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.345066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.346501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.348221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.350302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 66/131] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:12 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:12.351480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.386884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:12.390120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76660-695b-411c-906f-5c8bf4110019 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.465368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.466254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.466540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.467021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] PATH_INFO: `/v3/projects/5defe554fef440a6942f2d764958739e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.469429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] RBAC: Authorizing `identity:get_project(project_id=5defe554fef440a6942f2d764958739e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.471758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.476034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 66/132] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:12 2022] GET /identity/v3/projects/5defe554fef440a6942f2d764958739e => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:12.478365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.515643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd193a-0d1d-48d8-84f2-875390227f15 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.578721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.579668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.579966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.580251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.582553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.584046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.585714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 67/133] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:12 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:12.586730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.620159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:12.675642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84040-a75e-4653-8f84-9f97a34baf11 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.732672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.733938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.734450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.735000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d/users/4341a8c3a5294dcfa0689edce871eeb0/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.738035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:12.740244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=22d60acff64648e686937b1039fe715d, user_id=4341a8c3a5294dcfa0689edce871eeb0, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.742287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.745788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e6dad-55a3-4108-8601-66c074b15da4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:12.770032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 67/134] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:12 2022] PUT /identity/v3/projects/22d60acff64648e686937b1039fe715d/users/4341a8c3a5294dcfa0689edce871eeb0/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:12.771338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:12.789926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:12.792403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:12.792691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:12.793210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] PATH_INFO: `/v3/projects/5defe554fef440a6942f2d764958739e/users/4341a8c3a5294dcfa0689edce871eeb0/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:12.798471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] RBAC: Authorizing `identity:create_grant(project_id=5defe554fef440a6942f2d764958739e, user_id=4341a8c3a5294dcfa0689edce871eeb0, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:12.800764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:12.819652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 68/135] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:12 2022] PUT /identity/v3/projects/5defe554fef440a6942f2d764958739e/users/4341a8c3a5294dcfa0689edce871eeb0/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:12.976782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf0d0-ef33-4373-a3c7-e881462d1f7a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:13.024013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:13.039893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0949-7266-49ca-9d74-095cffbe7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:13.040997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0949-7266-49ca-9d74-095cffbe7f07 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:13.041294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0949-7266-49ca-9d74-095cffbe7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:13.041581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0949-7266-49ca-9d74-095cffbe7f07 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:13.042971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d0949-7266-49ca-9d74-095cffbe7f07 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:13.044515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d0949-7266-49ca-9d74-095cffbe7f07 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:13.046607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 68/136] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:12 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:13.052506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:13.105588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003757-e379-495a-ac52-36b3bc27d33f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:13.105904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003757-e379-495a-ac52-36b3bc27d33f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:13.106168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003757-e379-495a-ac52-36b3bc27d33f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:13.107793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 69/137] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:13.114443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:13.114747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:13.115027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:13.137216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:13.138660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:13.222385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2575a-24f9-44d7-9c3a-d82d329b3d2d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:13.225327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 70/138] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:13.257573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:13.269371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:13.270343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:13.270616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:13.270991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d/users/4341a8c3a5294dcfa0689edce871eeb0/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:13.276286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] RBAC: Authorizing `identity:create_grant(project_id=22d60acff64648e686937b1039fe715d, user_id=4341a8c3a5294dcfa0689edce871eeb0, role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:13.277929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:13.298490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 69/139] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:13 2022] PUT /identity/v3/projects/22d60acff64648e686937b1039fe715d/users/4341a8c3a5294dcfa0689edce871eeb0/roles/a35ac9e7d95640e99df8d5940692e128 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:13.385348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea376e4-85ea-4f4d-8c49-dc9a0cc8aa6c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:13.419510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:13.425824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a1ee1-85d0-4155-848d-c4dd40b65940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:13.426871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1ee1-85d0-4155-848d-c4dd40b65940 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:13.427429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1ee1-85d0-4155-848d-c4dd40b65940 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:13.427715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1ee1-85d0-4155-848d-c4dd40b65940 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:13.428977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a1ee1-85d0-4155-848d-c4dd40b65940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:13.430578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a1ee1-85d0-4155-848d-c4dd40b65940 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:13.432816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 71/140] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:13.438546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:13.471076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:13.558332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2acc-73a1-4491-86ef-845d586f665c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:13.604086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd5e38-4a85-4ca9-967c-2b5b98b74c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:13.604822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5e38-4a85-4ca9-967c-2b5b98b74c0b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:13.605110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5e38-4a85-4ca9-967c-2b5b98b74c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:13.605442 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5e38-4a85-4ca9-967c-2b5b98b74c0b None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:13.606167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd5e38-4a85-4ca9-967c-2b5b98b74c0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:13.607736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd5e38-4a85-4ca9-967c-2b5b98b74c0b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:13.641343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 70/141] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:13 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:14.845230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957df95-e44b-425e-bb80-06ec1e7d8522 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:14.845732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957df95-e44b-425e-bb80-06ec1e7d8522 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:14.845804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957df95-e44b-425e-bb80-06ec1e7d8522 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:14.847590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 72/142] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:14.854188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:14.854610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:14.854783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:14.876532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:14.877751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:14.965138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:14.969489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 71/143] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:15.007075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957df95-e44b-425e-bb80-06ec1e7d8522 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:15.144313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957df95-e44b-425e-bb80-06ec1e7d8522 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:15.189442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be40e-2a7f-43e2-b617-91843bbd9ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:15.190252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be40e-2a7f-43e2-b617-91843bbd9ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:15.190544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be40e-2a7f-43e2-b617-91843bbd9ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:15.190827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be40e-2a7f-43e2-b617-91843bbd9ac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:15.213427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282be40e-2a7f-43e2-b617-91843bbd9ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-282be40e-2a7f-43e2-b617-91843bbd9ac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:15.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:15.222519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:15.223308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 73/144] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:15.231112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:15.252055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35fa73-0cd6-41a4-a536-fbe8e8ef68cc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:15.252353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35fa73-0cd6-41a4-a536-fbe8e8ef68cc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:15.252804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35fa73-0cd6-41a4-a536-fbe8e8ef68cc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:15.254348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 74/145] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:15.260622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:15.261124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:15.261552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:15.300155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:15.301593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:15.397152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a1897-e76f-49d0-a0cd-639e38443257 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:15.421312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:15.453765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:15.454716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:15.455117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:15.455611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:15.456761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:15.457178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:15.458336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 75/146] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:15.459024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:15.472752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 72/147] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:15.479700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:15.491795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:15.646609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:15.669358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1a8cf-d875-4426-a8ce-e008855a9008 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:15.715663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:15.716563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:15.716860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:15.717143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] PATH_INFO: `/v3/users/6cc1f206a7534d478df8987147a33502` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:15.719535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b968e2-7323-44e0-9206-63adc6ae3eb1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:15.721720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] RBAC: Authorizing `identity:get_user(user_id=6cc1f206a7534d478df8987147a33502)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:15.723215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:15.727335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 76/148] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:15 2022] GET /identity/v3/users/6cc1f206a7534d478df8987147a33502 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:15.734288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:15.801939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:15.803713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:15.804705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:15.805306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:15.835711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:15.845207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:15.846314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:15.847260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:15.855415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 73/149] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:15.863960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:15.867677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:15.968587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43280c-7838-4503-ba0d-9a6075767a65 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.043598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.044277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.044565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.044848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.100325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49af1b4-b145-4bb6-b39c-6f0d97c4a453 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.134748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:16.160941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.161625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.161915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.162194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.162952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:16.163283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.164685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.179259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 74/150] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:16.179454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.181043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.185411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:16.277425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:16.349797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43111-b871-443d-9d79-45104d3cc641 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.374271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 77/151] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:16.379895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:16.403518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.404415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.404698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.404974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] PATH_INFO: `/v3/users/e616c37c599b40659f18b5ba4c8c195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.411871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] RBAC: Authorizing `identity:get_user(user_id=e616c37c599b40659f18b5ba4c8c195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.413768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.416746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 75/152] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:16 2022] GET /identity/v3/users/e616c37c599b40659f18b5ba4c8c195f => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:16.421972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:16.515490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:16.536221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a4a41-6b70-440e-9b25-3b636ebab8c9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.578576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.579865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.580377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.580857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.582325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.584025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.585993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 78/153] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:16 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:16.589458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef849d84-8e23-4eff-b5ed-1f520aa10548 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.592811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:16.626298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:16.655118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.655118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.655118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.655118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.660339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.661944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.664123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 76/154] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:16 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:16.676506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:16.754208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac7c2b-8169-4052-b7cd-77f19c576ca3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.812438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.813024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.813312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.813595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.814438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=6cc1f206a7534d478df8987147a33502) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:16.814753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.820444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede0984-f45d-41df-bad3-e4de88cf0a9e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.827925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 79/155] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:16 2022] GET /identity/v3/role_assignments?user.id=6cc1f206a7534d478df8987147a33502&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:16.832234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38672-acd6-4c62-b729-f2a8c544c287 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:16.863449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:16.872726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e3fd-4d62-4738-965d-b6b0ef32f402 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.873262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e3fd-4d62-4738-965d-b6b0ef32f402 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.873262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e3fd-4d62-4738-965d-b6b0ef32f402 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.874817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 80/156] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:16.880693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c852-976d-48ea-b05e-e5a6a05aa98a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.881066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c852-976d-48ea-b05e-e5a6a05aa98a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.881283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c852-976d-48ea-b05e-e5a6a05aa98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.895966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:16.896905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:16.897195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:16.897473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d/users/e616c37c599b40659f18b5ba4c8c195f/roles/72e9940f6d44456c9aa6261eb83d0c54` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:16.900850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] RBAC: Authorizing `identity:create_grant(project_id=22d60acff64648e686937b1039fe715d, user_id=e616c37c599b40659f18b5ba4c8c195f, role_id=72e9940f6d44456c9aa6261eb83d0c54)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:16.902334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:16.922234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9344c852-976d-48ea-b05e-e5a6a05aa98a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:16.923989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9344c852-976d-48ea-b05e-e5a6a05aa98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:16.925989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 77/157] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:16 2022] PUT /identity/v3/projects/22d60acff64648e686937b1039fe715d/users/e616c37c599b40659f18b5ba4c8c195f/roles/72e9940f6d44456c9aa6261eb83d0c54 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:54:17.053549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:17.122636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:17.200620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869a20-d769-4f3c-9f2d-c8f3c7f731e2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:17.201320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869a20-d769-4f3c-9f2d-c8f3c7f731e2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:17.201812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869a20-d769-4f3c-9f2d-c8f3c7f731e2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:17.203657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 82/159] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:17.210456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:17.211142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:17.211668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:17.246691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:17.247937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:17.275127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6696-c511-4c70-a011-4e5b8198b271 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:17.275532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:17.363551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:17.364730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:17.365193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:17.365503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:17.386990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:17.393677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 83/160] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:17.395764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:17.396678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:17.397436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 78/161] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:17.403005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:17.453021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:17.546219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:17.623386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3aa44-83f8-4d17-b701-d3b8ec732f3a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:17.670912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c734-4684-44b3-b75a-baa6bc78f7c5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:17.704421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:17.705080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:17.705367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:17.705659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:17.706397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:17.706703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:17.708207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:17.722558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 84/162] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:17.728845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:17.752665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:17.754117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:17.754412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:17.754697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:17.755429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:17.776684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:17.785533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:17.786464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:17.787280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 79/163] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:17.794961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:17.963400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1c7f-e0f0-4df5-b5c3-a414fb65039b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:17.984082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:17.988252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fcf6d-d4d6-46b9-9012-009b4dbe1bf9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:18.064571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf07ec-9438-488f-be6d-22cd9e1a8bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.065276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.065486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf07ec-9438-488f-be6d-22cd9e1a8bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.065758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf07ec-9438-488f-be6d-22cd9e1a8bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.065963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.066084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf07ec-9438-488f-be6d-22cd9e1a8bf1 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.066251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.066540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.067284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf07ec-9438-488f-be6d-22cd9e1a8bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:18.067386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:18.067613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:18.068760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf07ec-9438-488f-be6d-22cd9e1a8bf1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:18.069191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:18.070416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 85/164] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:17 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:18.071822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167ad0-864b-446c-92ce-c104ec717078 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.072115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167ad0-864b-446c-92ce-c104ec717078 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.072400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167ad0-864b-446c-92ce-c104ec717078 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.073649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 86/165] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:18.080634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.080904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.081191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.087327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 80/166] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:18.088185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:18.108509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:18.109686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:18.235321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110df2-563e-45b7-afff-2c17d064f3c2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:18.283906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 87/167] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:18.284792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:18.286102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802783f-d544-4214-8b56-6f4f7301d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.286767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802783f-d544-4214-8b56-6f4f7301d07d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.287048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802783f-d544-4214-8b56-6f4f7301d07d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.287350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802783f-d544-4214-8b56-6f4f7301d07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.309976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:18.345201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:18.421751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802783f-d544-4214-8b56-6f4f7301d07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:18.423671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802783f-d544-4214-8b56-6f4f7301d07d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:18.455068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922c54a-7ca0-4210-bea8-071d9c6188ef None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:18.493827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.494886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.495201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.495484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.496886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:18.498358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:18.501004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 88/168] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:18 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:18.501806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:18.589270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:18.616755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7867-94d8-4032-b0b5-6cad20e03653 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:18.653545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 81/169] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:18.657938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac1d08-dd6c-45d4-9c27-0837beb1b09b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.658768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac1d08-dd6c-45d4-9c27-0837beb1b09b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.660588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac1d08-dd6c-45d4-9c27-0837beb1b09b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.662162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 82/170] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:18.663270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac1d08-dd6c-45d4-9c27-0837beb1b09b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:18.691621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.693012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.693504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.693982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.722644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:18.734065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:18.734992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:18.735798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 89/171] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:18.736427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:18.762391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:18.847775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac1d08-dd6c-45d4-9c27-0837beb1b09b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:18.892920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c7f56-7f84-4396-80ca-ca051b3a4077 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:18.932101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c1d5-b785-4ffb-b655-aa1e52b60323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.933154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c1d5-b785-4ffb-b655-aa1e52b60323 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.933769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c1d5-b785-4ffb-b655-aa1e52b60323 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.934060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c1d5-b785-4ffb-b655-aa1e52b60323 None admin] PATH_INFO: `/v3/projects/5defe554fef440a6942f2d764958739e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.935452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c1d5-b785-4ffb-b655-aa1e52b60323 None admin] RBAC: Authorizing `identity:get_project(project_id=5defe554fef440a6942f2d764958739e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:18.936915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c1d5-b785-4ffb-b655-aa1e52b60323 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:18.938630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 90/172] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:18 2022] GET /identity/v3/projects/5defe554fef440a6942f2d764958739e => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:18.940060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.940348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.940631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.959465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:18.960202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:18.960489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:18.960815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:18.963740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:18.976260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:18.977541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:19.052845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.054357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.125733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:19.160774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 91/173] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:19.161741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.170533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 83/174] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:19.171474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.272393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276a06-82e2-4520-aaa2-4d72e3915b92 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.278785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e602c83-61db-4125-aa62-c826b0460d2d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.308570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.309160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.309444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.309720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.310478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:19.310787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.312207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ee10-fc45-416b-8db5-7386c691d794 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.313554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:19.316713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.317455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.317916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.318082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.318882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=5defe554fef440a6942f2d764958739e, user.id=4341a8c3a5294dcfa0689edce871eeb0) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:19.319249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.320720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.322468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 92/175] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:19.323755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bb11-4f4c-4133-8488-2b3694225326 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.324046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bb11-4f4c-4133-8488-2b3694225326 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.324323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bb11-4f4c-4133-8488-2b3694225326 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.325671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 93/176] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:19.326669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9773e-fc55-42b7-a7de-460db9dbd5c2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.327187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9773e-fc55-42b7-a7de-460db9dbd5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.327283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9773e-fc55-42b7-a7de-460db9dbd5c2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.328577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 94/177] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:19.333114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9773e-fc55-42b7-a7de-460db9dbd5c2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.335791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 84/178] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/role_assignments?user.id=4341a8c3a5294dcfa0689edce871eeb0&scope.project.id=5defe554fef440a6942f2d764958739e&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:19.343388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.379102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:19.450278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9773e-fc55-42b7-a7de-460db9dbd5c2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.470353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dace038-fefa-4597-9fd6-5ee33fe8334b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.487909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.488793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.489078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.489361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.490625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.492145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.494357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 95/179] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:19.495368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.516874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52607191-a1d7-4cd1-ac1d-fae587238493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.518074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607191-a1d7-4cd1-ac1d-fae587238493 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.518594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607191-a1d7-4cd1-ac1d-fae587238493 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.519232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607191-a1d7-4cd1-ac1d-fae587238493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.533101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52607191-a1d7-4cd1-ac1d-fae587238493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-52607191-a1d7-4cd1-ac1d-fae587238493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:19.541596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:19.542498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:19.543783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 85/180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:19.544732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9925-43eb-4597-89bb-564f7f3583ff None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.544732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9925-43eb-4597-89bb-564f7f3583ff None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.544732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9925-43eb-4597-89bb-564f7f3583ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.565350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-63cf9925-43eb-4597-89bb-564f7f3583ff None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:19.566850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-63cf9925-43eb-4597-89bb-564f7f3583ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:19.573587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:19.626728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b518e-9eca-445b-83d9-7043079aa31c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.658442 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 86/181] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:19.659763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.660309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.660585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.674828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.676182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.676755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.677260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] PATH_INFO: `/v3/users/4341a8c3a5294dcfa0689edce871eeb0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.677366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:19.678515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:19.679015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] RBAC: Authorizing `identity:get_user(user_id=4341a8c3a5294dcfa0689edce871eeb0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.681223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.683932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 96/182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/users/4341a8c3a5294dcfa0689edce871eeb0 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:19.684745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.691321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:19.763250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 87/183] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:19.764187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.803020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bbd4e-a555-4b63-b627-0211fb32e691 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.834643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:19.840350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.841021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.841300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.841574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.842412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=4341a8c3a5294dcfa0689edce871eeb0) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:19.842723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.844190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.859356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 97/184] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/role_assignments?user.id=4341a8c3a5294dcfa0689edce871eeb0&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:19.859356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.883818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139827d9-7c8a-4eae-a182-3b7014a97051 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:19.925501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:19.926198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:19.926613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:19.926898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:19.927835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:19.928149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:19.929601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:19.940717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 88/185] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:19.941673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:19.955932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.001872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b235f-e796-4630-9b5b-2dec582aa946 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.049289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.050411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.050910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.051428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.064781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:20.075336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:20.076253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:20.077025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:20.079378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f66fb-e61e-4058-b359-cad93721196f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.080228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 98/186] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:20.081293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.125517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.126105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.126394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.126676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.156138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.211333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31818d-c12e-4193-89db-3c83d78a4b4a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.218579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.220167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.231056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.246888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.247710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.247994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.248272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.249436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.250869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.252537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 99/187] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:20.253290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.321824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 89/188] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:20.322770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.369791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54657f7-04e4-4057-a162-5a81ed1f0b6f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.392499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.403954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de20c1-0c7c-4cad-9d85-c05d49214547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.404910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de20c1-0c7c-4cad-9d85-c05d49214547 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.405200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de20c1-0c7c-4cad-9d85-c05d49214547 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.405485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de20c1-0c7c-4cad-9d85-c05d49214547 None admin] PATH_INFO: `/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.420889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de20c1-0c7c-4cad-9d85-c05d49214547 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1e872dfd48abad8a2fc5eba06ea2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.422350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de20c1-0c7c-4cad-9d85-c05d49214547 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.424055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 100/189] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:20.425271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3004a0-9b76-4637-8299-ffcb08a87257 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.429833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19411e6-1c83-4e0c-8f25-2cbac71513ac None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.430128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19411e6-1c83-4e0c-8f25-2cbac71513ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.430413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19411e6-1c83-4e0c-8f25-2cbac71513ac None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.432341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 101/190] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:20.433023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19411e6-1c83-4e0c-8f25-2cbac71513ac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.435659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.462532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.463244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.463526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.463801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.464550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:20.464862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.466227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.473955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 90/191] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:20.474732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.538275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19411e6-1c83-4e0c-8f25-2cbac71513ac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.571720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.572386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.572677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.572958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.573659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.575126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.576014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2cfe1-efb0-4a75-a813-4df3f76b4c3a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.601735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 102/192] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:20 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:20.603381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.613657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf607e-5413-4d09-bc55-41753becec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.614591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf607e-5413-4d09-bc55-41753becec05 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.614872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf607e-5413-4d09-bc55-41753becec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.615183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf607e-5413-4d09-bc55-41753becec05 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.616460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf607e-5413-4d09-bc55-41753becec05 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.618064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf607e-5413-4d09-bc55-41753becec05 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.620718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 91/193] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:20.622013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.622304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.622584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.640855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:20.642066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:20.656529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.679918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.725394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 92/194] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:20.726267 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.731318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ba103-8a03-4ff7-8d2c-73f734c3b2c0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.770772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.771483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.771773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.772052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.846359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d522-314c-454a-9a65-28b90751ab2d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:20.863427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.866092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.890536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:20.891880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:20.892170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:20.892723 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] PATH_INFO: `/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:20.894197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1e872dfd48abad8a2fc5eba06ea2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:20.896118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:20.897772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 93/195] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:20.898548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:20.920472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:20.948049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.009044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 103/196] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:21.009044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.037457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2acf05-cb2c-493f-940e-2ea6ecdf9797 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.082265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.082917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.083277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.083820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.084837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] RBAC: Adding query filter params (role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=4341a8c3a5294dcfa0689edce871eeb0) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:21.085157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:21.087453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:21.095842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 94/197] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:20 2022] GET /identity/v3/role_assignments?user.id=4341a8c3a5294dcfa0689edce871eeb0&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:21.096811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.174045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11d081-b42e-4d85-a66c-0107fd114ff3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.251108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.252048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.252339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.252620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.273774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:21.283480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:21.289143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:21.290512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:21.291714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:21.295198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 104/198] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:21.296326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.302399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.308087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13c84-d09e-4b8d-b574-b50d59e2d1f8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.348074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.348887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.349182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.349458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.445721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:21.448837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:21.468281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0706-fcfd-4ded-82d4-64526ed1c1e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.508660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.509998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.510552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.511214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.512689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:21.514504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:21.517561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 105/199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:21.518557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.577965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.582859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 95/200] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:21.584711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.602063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.650505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b2c13-f9c3-4ac2-83ce-116e1d54be12 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.689604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.690686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.691208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.691701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.692639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:21.693143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:21.694714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:21.704757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 106/201] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:21.705848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.715611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b966-99d2-4346-96f7-12228a06e758 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.753390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.755389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.755389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.755389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.756398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=c7cd1e872dfd48abad8a2fc5eba06ea2) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:21.756912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:21.759485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:21.765909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 96/202] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/role_assignments?user.id=c7cd1e872dfd48abad8a2fc5eba06ea2&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:21.766993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.870451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceea00-5d8c-4a64-b475-aef3852ff38b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:21.895755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.929411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:21.943049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:21.943959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:21.944244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:21.944517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:21.947630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:21.949100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:21.951069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 107/203] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:21.957245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:21.984677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35dd0e-2856-4f14-9fd1-334e2fcade8c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:22.057625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:22.058519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:22.058803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:22.059079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] PATH_INFO: `/v3/users/e616c37c599b40659f18b5ba4c8c195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:22.060530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] RBAC: Authorizing `identity:get_user(user_id=e616c37c599b40659f18b5ba4c8c195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:22.062675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:22.065099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 97/204] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/users/e616c37c599b40659f18b5ba4c8c195f => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:22.072084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:22.168925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f719-318d-47ae-8e54-0d271fffbb66 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:22.239881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:22.240639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:22.241037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:22.241413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:22.242360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] RBAC: Adding query filter params (role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=c7cd1e872dfd48abad8a2fc5eba06ea2) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:22.242770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:22.244668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:22.257229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5daa-4d20-4615-b35d-77fcb09e4a8b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:22.257708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 108/205] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:21 2022] GET /identity/v3/role_assignments?user.id=c7cd1e872dfd48abad8a2fc5eba06ea2&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:22.292921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:22.299721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:22.300635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:22.301079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:22.301501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:22.377713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:22.379476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:22.489356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 98/206] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:22.495029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:22.581397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:22.637862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde8370-80ad-48b5-97ca-b77cbd80c379 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:22.677181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15714f8a-7830-40ce-83d4-3b6a2d07cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:22.678059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714f8a-7830-40ce-83d4-3b6a2d07cf48 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:22.678340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714f8a-7830-40ce-83d4-3b6a2d07cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:22.678616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714f8a-7830-40ce-83d4-3b6a2d07cf48 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:22.679833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714f8a-7830-40ce-83d4-3b6a2d07cf48 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:22.681725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714f8a-7830-40ce-83d4-3b6a2d07cf48 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:22.683484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 109/207] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:22 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:22.689621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:22.732629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:22.809359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3696773-2c61-4af6-827c-1935778657b8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:22.846174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:22.847227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:22.847739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:22.848214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:22.849260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] RBAC: Adding query filter params (role.id=72e9940f6d44456c9aa6261eb83d0c54, scope.project.id=22d60acff64648e686937b1039fe715d, user.id=e616c37c599b40659f18b5ba4c8c195f) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:22.849770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:22.851449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c325fb-1109-4e0e-b1d0-c75639f1e323 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:22.858843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 99/208] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:22 2022] GET /identity/v3/role_assignments?user.id=e616c37c599b40659f18b5ba4c8c195f&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=72e9940f6d44456c9aa6261eb83d0c54 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:23.236495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df918-eaa1-4c67-a7cf-0e888da94e67 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.236969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df918-eaa1-4c67-a7cf-0e888da94e67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.236969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df918-eaa1-4c67-a7cf-0e888da94e67 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.238482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 110/209] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:23.244535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.245101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.245644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.267329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:23.268539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:23.319999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e688-06f0-4f31-b8bc-e5d134933ff3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.320746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e688-06f0-4f31-b8bc-e5d134933ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.321741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e688-06f0-4f31-b8bc-e5d134933ff3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.324081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 111/210] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:23.331000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.331607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.332087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.348021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 100/211] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:23.353563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:23.355006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:23.373444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:23.403798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:23.438269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 112/212] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:23.470166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:23.497491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee023d-036a-43f6-b633-0f7ac17cb204 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:23.533611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:23.534556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.534666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.535265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.536491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:23.537833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:23.538072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:23.540055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 101/213] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:23.545584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:23.585703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b744-38b4-43a7-b30e-1c12326087f7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:23.623680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:23.624824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.625305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.625796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.638949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:23.647128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:23.647996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:23.648823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:23.650247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:23.651734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 113/214] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:23.656069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4fa60-c3e8-4669-867b-aedff2b8c6ff None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:23.657758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:23.693007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:23.693640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.693926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.694269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.695015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:23.697347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:23.722075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 102/215] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:23 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:23.779863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ba57-baf1-43be-a6f9-62fe296831f5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:23.801232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:23.820980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:23.821937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:23.822344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:23.822724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:23.823663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:23.824077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:23.825624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:23.835726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 114/216] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:23.842050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:23.966375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067124e-0600-4b2c-b54a-8afe04cdd5a0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:24.001615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d0c89-50cc-4d46-9560-bcc218af7c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:24.002763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d0c89-50cc-4d46-9560-bcc218af7c3e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.003219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d0c89-50cc-4d46-9560-bcc218af7c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.003632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d0c89-50cc-4d46-9560-bcc218af7c3e None admin] PATH_INFO: `/v3/users/fc94740e2afe4f00b424ba8cd4a80da0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.019063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d0c89-50cc-4d46-9560-bcc218af7c3e None admin] RBAC: Authorizing `identity:get_user(user_id=fc94740e2afe4f00b424ba8cd4a80da0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:24.020787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d0c89-50cc-4d46-9560-bcc218af7c3e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:24.023054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 103/217] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:23 2022] GET /identity/v3/users/fc94740e2afe4f00b424ba8cd4a80da0 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:24.029659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:24.148123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef44ced-9087-49a0-98e0-98cf9f3a13d5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:24.191014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:24.191809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.192092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.192372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.251013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:24.276263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:24.278009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:24.373472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00fe79-daed-4d68-8eee-721c4547bea2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.373968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00fe79-daed-4d68-8eee-721c4547bea2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.373968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00fe79-daed-4d68-8eee-721c4547bea2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.376858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 104/218] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:24.381882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.382175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.382462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.418881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 115/219] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:24.424871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:24.437410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:24.438650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:24.446573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:24.540206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 105/220] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:24.591292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:24.592998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:24.648758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13034871-2ec5-401e-89e8-8400a8b43b4a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:24.726813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:24.728491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.728777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.729055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.730349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:24.731992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:24.739564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 116/221] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:24 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:24.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:24.751669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a229bf-2f9a-4368-89d5-e2febbcac0c8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:24.807764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:24.808594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.808881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.809160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.827433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:24.833205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:24.847899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:24.848835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:24.849624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 106/222] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:24.859608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:24.924155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8768ed-d8ba-4dce-ab0f-e73a2493d6af None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:24.980030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:24.980707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.980992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.981269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.982111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=fc94740e2afe4f00b424ba8cd4a80da0) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:24.982423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:24.984056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98060f8-c060-45ae-8e65-e3214efe37de None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:24.990430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 117/223] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:24 2022] GET /identity/v3/role_assignments?user.id=fc94740e2afe4f00b424ba8cd4a80da0&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:24.991799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2bdc-652d-48a6-a49e-0c12b686b2d8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:24.992063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2bdc-652d-48a6-a49e-0c12b686b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:24.992338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2bdc-652d-48a6-a49e-0c12b686b2d8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:24.994866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 118/224] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:25.000493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.000960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.001337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.005137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c53a2-46f7-45be-a030-779493ebd223 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.022105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:25.023713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:25.033687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:25.098228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.100125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.101651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.101950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.103975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:25.104293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:25.105752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:25.142463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 107/225] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:25.147746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:25.191535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 119/226] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:25.219784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:25.261821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:25.315297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e5b7-bbcb-4f00-be43-2bcfbaf8c0f8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.363532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292af3-517a-4518-ade8-f8111c6b5ba3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.364046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.364672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.364964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.365246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] PATH_INFO: `/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.367232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1e872dfd48abad8a2fc5eba06ea2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:25.369376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:25.371233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 108/227] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:25 2022] GET /identity/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:25.402449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:25.425325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.426169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.426510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.426797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.444700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:25.463337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:25.464262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:25.465267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 120/228] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:25.472226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:25.476164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:25.519937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9ad4-ff50-44a3-b2de-51e666878d60 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.550769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:25.562853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.564098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.564706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.565211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.566689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:25.575618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:25.578379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 109/229] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:25 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:25.585012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:25.644300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8586ff7-16c9-4f34-87ec-84c9fadc8b0f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.689696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.690380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.690669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.690947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.691734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:25.692041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:25.693448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:25.715989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 121/230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:25.721855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:25.753906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410d0f-7649-4e88-9d51-8cb4334d90eb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.792114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.793016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.793348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.793632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/c7cd1e872dfd48abad8a2fc5eba06ea2/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.795781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ac761817d8b494bb2464da6990cd64b, user_id=c7cd1e872dfd48abad8a2fc5eba06ea2, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:25.797298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:25.821987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 110/231] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:25 2022] PUT /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/c7cd1e872dfd48abad8a2fc5eba06ea2/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:54:25.863540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:25.885499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503051-a327-46c4-82ec-e9d198a92567 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:25.924805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:25.925694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:25.926089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:25.926374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] PATH_INFO: `/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:25.927648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1e872dfd48abad8a2fc5eba06ea2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:25.929209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:25.931239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 122/232] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:25 2022] GET /identity/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:25.940354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:26.020718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:26.088518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae20b28-6294-4e6d-93d7-1715723641b3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:26.127233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2919-cd0e-4da1-9882-d6e7f0625751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:26.128458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2919-cd0e-4da1-9882-d6e7f0625751 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.128947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2919-cd0e-4da1-9882-d6e7f0625751 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.129422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2919-cd0e-4da1-9882-d6e7f0625751 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.130871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a2919-cd0e-4da1-9882-d6e7f0625751 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:26.132564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a2919-cd0e-4da1-9882-d6e7f0625751 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:26.135478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 111/233] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:25 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:26.141016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:26.315286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c0e8-457d-47e7-b148-8a6abb0ba9c5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:26.372128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:26.377967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc869867-9e3d-418a-82ee-ad8fa804cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:26.378870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869867-9e3d-418a-82ee-ad8fa804cc4c None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.379193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869867-9e3d-418a-82ee-ad8fa804cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.383989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869867-9e3d-418a-82ee-ad8fa804cc4c None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/c7cd1e872dfd48abad8a2fc5eba06ea2/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.386299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc869867-9e3d-418a-82ee-ad8fa804cc4c None admin] RBAC: Authorizing `identity:create_grant(project_id=4ac761817d8b494bb2464da6990cd64b, user_id=c7cd1e872dfd48abad8a2fc5eba06ea2, role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:26.387788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc869867-9e3d-418a-82ee-ad8fa804cc4c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:26.414722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 123/234] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:26 2022] PUT /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/c7cd1e872dfd48abad8a2fc5eba06ea2/roles/a35ac9e7d95640e99df8d5940692e128 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:26.622066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3c9e-61a8-4097-8abd-861302520089 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.622066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3c9e-61a8-4097-8abd-861302520089 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.622066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3c9e-61a8-4097-8abd-861302520089 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.623154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 112/235] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:26.629074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75faa6-0276-4bd1-8263-ef59815e2b5b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.629368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75faa6-0276-4bd1-8263-ef59815e2b5b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.629655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75faa6-0276-4bd1-8263-ef59815e2b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8d75faa6-0276-4bd1-8263-ef59815e2b5b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:26.655024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8d75faa6-0276-4bd1-8263-ef59815e2b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:26.745261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 124/236] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:26.770649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3c9e-61a8-4097-8abd-861302520089 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:26.888713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3c9e-61a8-4097-8abd-861302520089 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:26.923196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:26.929723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7145fa9-f9ac-4be0-80f3-626663d06aa7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.930020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7145fa9-f9ac-4be0-80f3-626663d06aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.930422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7145fa9-f9ac-4be0-80f3-626663d06aa7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.932098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 125/237] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:26.939410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.939883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.940268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.941508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:26.942568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:26.942985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:26.943418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:26.944696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:26.946983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:26.949140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 113/238] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:26.955592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:26.968593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:26.975122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:27.097937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 126/239] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:27.121349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:27.152352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61624-c06e-465c-a4c1-36e96cfac680 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:27.207459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:27.215291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:27.216025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.216313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.216592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.217316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:27.218778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:27.254376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 114/240] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:26 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:27.291293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e79e5-47cb-4b04-aa7d-3b7f9b340209 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:27.345017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:27.345848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.346136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.346415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.369148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:27.377396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:27.378758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:27.379581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 127/241] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:27.387462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:27.458680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:27.529258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e477f42-72bb-4bd0-a147-1e0e2a1007c7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:27.566092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:27.567121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.567604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.568071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.569018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:27.569546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:27.571284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:27.580630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 115/242] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:27.586381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:27.694461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6e5a2-e9d8-42af-8937-cb94c1e2d177 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:27.712121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:27.735120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed6038-d83e-4190-8967-22da42b8633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:27.736399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6038-d83e-4190-8967-22da42b8633b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.736880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6038-d83e-4190-8967-22da42b8633b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.737349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6038-d83e-4190-8967-22da42b8633b None admin] PATH_INFO: `/v3/users/8ad376cc61574690b97f947f8eec689e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.751983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed6038-d83e-4190-8967-22da42b8633b None admin] RBAC: Authorizing `identity:get_user(user_id=8ad376cc61574690b97f947f8eec689e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:27.754335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed6038-d83e-4190-8967-22da42b8633b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:27.756658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 128/243] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:27 2022] GET /identity/v3/users/8ad376cc61574690b97f947f8eec689e => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:27.762977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:27.871241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe1209-47f8-4e95-9b87-3784b85a2ddd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:27.882476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:27.909264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:27.910536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.911021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.911531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.917940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086575-63f3-44f3-bee8-cabab475a6d1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.918233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086575-63f3-44f3-bee8-cabab475a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.918495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086575-63f3-44f3-bee8-cabab475a6d1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.920057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 129/244] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:27.933516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:27.934119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:27.934623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:27.954429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:27.955982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:28.005066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:28.006506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:28.056148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 130/245] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:28.078595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:28.150028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 116/246] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:28.151878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:28.165534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:28.207238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:28.210918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16bd9c-7c3e-4627-810d-786f07ac44bf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:28.258374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:28.260589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.261010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.261431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.273160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:28.283780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:28.285224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:28.286197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:28.289038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 131/247] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:28.298584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:28.308012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78676cd9-2614-4a76-a5e1-5c60d0fcb87e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:28.391126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:28.391126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.391126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.391126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.391576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:28.392356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:28.394550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 117/248] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:28 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:28.400610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:28.440262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b943e-bcd9-4556-a8d0-b09a95ee4e64 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:28.485073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:28.485998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.486427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.486846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.487998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:28.488448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:28.489974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:28.507006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 132/249] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:28.512684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:28.554223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:28.636745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:28.658024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6450-612d-4c52-b2e5-4be52805d5f2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:28.698075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbd318-8b4e-4b54-b029-9adebf1a861e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:28.720679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56046bfb-1f17-4334-9161-a2091d5b9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:28.721566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56046bfb-1f17-4334-9161-a2091d5b9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.721852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56046bfb-1f17-4334-9161-a2091d5b9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.722131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56046bfb-1f17-4334-9161-a2091d5b9fe9 None admin] PATH_INFO: `/v3/users/fc94740e2afe4f00b424ba8cd4a80da0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.723395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56046bfb-1f17-4334-9161-a2091d5b9fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=fc94740e2afe4f00b424ba8cd4a80da0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:28.724852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56046bfb-1f17-4334-9161-a2091d5b9fe9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:28.731251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 133/250] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:28 2022] GET /identity/v3/users/fc94740e2afe4f00b424ba8cd4a80da0 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:28.732609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186c9b-5b85-4e7c-8be6-ef7ccdfeea20 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.732906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186c9b-5b85-4e7c-8be6-ef7ccdfeea20 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.733196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186c9b-5b85-4e7c-8be6-ef7ccdfeea20 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.736125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 134/251] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:28.738437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54186c9b-5b85-4e7c-8be6-ef7ccdfeea20 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:28.786329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:28.787022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.787313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.787603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.788459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] RBAC: Adding query filter params (role.id=72e9940f6d44456c9aa6261eb83d0c54, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=8ad376cc61574690b97f947f8eec689e) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:28.788777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:28.790274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dba311-552b-4397-becf-9fef2f8bffec None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:28.815654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 118/252] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:28 2022] GET /identity/v3/role_assignments?user.id=8ad376cc61574690b97f947f8eec689e&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=72e9940f6d44456c9aa6261eb83d0c54 => generated 259 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:28.817210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:28.817508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:28.817793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:28.856136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:28.857340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:28.943447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:28.966098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54186c9b-5b85-4e7c-8be6-ef7ccdfeea20 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:29.015260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 119/253] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:29.029957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:29.030906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.031229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.031509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.039210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:29.039210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:29.043156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 135/254] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:28 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:29.049113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:29.073759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:29.231382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244391-2e7e-4849-a610-f3bf52cf4e73 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:29.278843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:29.279541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:29.279732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.280025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.280309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.301429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:29.315927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:29.316824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:29.317602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:29.319798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 136/255] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:29.323221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:29.357918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:29.373055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7748d4-13ef-4444-9099-1e8ba3d1895c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:29.482130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947490da-b59a-4709-8058-1c5a4a301a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:29.483035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947490da-b59a-4709-8058-1c5a4a301a48 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.483347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947490da-b59a-4709-8058-1c5a4a301a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.483627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947490da-b59a-4709-8058-1c5a4a301a48 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/fc94740e2afe4f00b424ba8cd4a80da0/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.486365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947490da-b59a-4709-8058-1c5a4a301a48 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ac761817d8b494bb2464da6990cd64b, user_id=fc94740e2afe4f00b424ba8cd4a80da0, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:29.487857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947490da-b59a-4709-8058-1c5a4a301a48 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:29.500396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885d856-25e6-432a-a6cc-fa13f4140196 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:29.515558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 120/256] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:29 2022] PUT /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/fc94740e2afe4f00b424ba8cd4a80da0/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:29.518026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c472d9-2b45-4c06-84f2-94cbd5d8ea5e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.518323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c472d9-2b45-4c06-84f2-94cbd5d8ea5e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.520564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c472d9-2b45-4c06-84f2-94cbd5d8ea5e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.522808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 121/257] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:29.534385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.534751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.535316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.568354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:29.570535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:29.587687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:29.588456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.588743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.589023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.589791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:29.590099 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:29.591561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:29.614120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 137/258] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:29.620025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:29.740438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 122/259] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:29.755426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:29.790386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6b65c-9230-4ec2-8f3c-1465e2007a66 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:29.802753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:29.834826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:29.836321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:29.836980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:29.837496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] PATH_INFO: `/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:29.839795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1e872dfd48abad8a2fc5eba06ea2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:29.841877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:29.843760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 138/260] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:29 2022] GET /identity/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:29.849906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:29.979465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:29.988967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8746fb-d2c7-4340-8535-53444c93960a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:30.036033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:30.036708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.036996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.037274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.060772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:30.073667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895d546-66c9-4754-bc97-f1add74dac31 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:30.130915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:30.131750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.132044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.132322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.148074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:30.158030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:30.159014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:30.160105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 123/261] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:30.166324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:30.217533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:30.219028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:30.342091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f0e6-e48e-4114-8449-9cfff5a825ec None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:30.398402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 139/262] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 14:54:30.402427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:30.406387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:30.431797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:30.432483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.432776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.433061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.433829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:30.434145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:30.435588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:30.454396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 124/263] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:30.460253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:30.485648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:30.541159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa6b3-a0ce-41bc-a4e7-e7a82853162c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:30.598194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:30.599076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.599397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.599675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.603880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:30.605438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:30.607763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 140/264] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:30 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:30.614116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:30.768292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde51b5c-c174-477b-be74-3aff963f5b04 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:30.791413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:30.812173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:30.812855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.813209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.813548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.814395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=c7cd1e872dfd48abad8a2fc5eba06ea2) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:30.814714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:30.816349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:30.823252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 141/265] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:30 2022] GET /identity/v3/role_assignments?user.id=c7cd1e872dfd48abad8a2fc5eba06ea2&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:30.833725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034de8f-4c9b-470b-964b-2ec580e0fce5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:30.892284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef311d-d4fa-49b8-9053-33d6c183ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:30.893191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef311d-d4fa-49b8-9053-33d6c183ac78 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.893482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef311d-d4fa-49b8-9053-33d6c183ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.893764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef311d-d4fa-49b8-9053-33d6c183ac78 None admin] PATH_INFO: `/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.896532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef311d-d4fa-49b8-9053-33d6c183ac78 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1e872dfd48abad8a2fc5eba06ea2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:30.898040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef311d-d4fa-49b8-9053-33d6c183ac78 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:30.900202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 125/266] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:30 2022] GET /identity/v3/users/c7cd1e872dfd48abad8a2fc5eba06ea2 => generated 283 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:30.905626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:30.925684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980cb33-bc6e-48c4-9e89-c1f46e55401f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.926000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980cb33-bc6e-48c4-9e89-c1f46e55401f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.926262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980cb33-bc6e-48c4-9e89-c1f46e55401f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.928027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 126/267] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:30.934063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0da7b8-1e4f-4761-b62c-e88e87a2810c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:30.934373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0da7b8-1e4f-4761-b62c-e88e87a2810c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:30.934645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0da7b8-1e4f-4761-b62c-e88e87a2810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:30.969493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2f0da7b8-1e4f-4761-b62c-e88e87a2810c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:30.970718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f0da7b8-1e4f-4761-b62c-e88e87a2810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:31.027916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8d9e-9e2e-4f21-86b3-7ced20930ad2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.066646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.067357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.067647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.067931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.080466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:31.128460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:31.136900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 127/268] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:31.138190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24eea-e7be-43c7-80ab-eda3f39d4bef None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.138501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24eea-e7be-43c7-80ab-eda3f39d4bef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.138774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24eea-e7be-43c7-80ab-eda3f39d4bef None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.140114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 128/269] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:31.147150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.147414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.147707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.151769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:31.153455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:31.185788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:31.186980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:31.263837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 142/270] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:31.264685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:31.284662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 129/271] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:31.285620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:31.361407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:31.387886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85544d9-5e5e-4efa-af02-41908fde558c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.438565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb1e66-bdc4-49ca-b15a-325e65b52d96 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.443130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.443926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.444304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.444527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.446221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:31.447841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:31.449785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 143/272] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:31.450572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:31.454887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:31.483967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.485493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.485785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.486068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.487531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:31.489898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:31.491657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 130/273] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:31 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:31.492405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:31.568043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63692f2-7c4f-473f-9345-a8cfb545ea9a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.605181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.606043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.606335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.606616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.613673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80aa9e-9438-44b0-a42c-0ee6bf9bbfe5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.617691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:31.625931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:31.626830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:31.627650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 144/274] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:31.628765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:31.641036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:31.650071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.650751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.651030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.651332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.652039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:31.653497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:31.679308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 131/275] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:31 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:31.680873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:31.740217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:31.759911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7da8-009e-4a38-801d-17a0c4e77c19 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.817652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.818712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.818982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.819233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.820372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] RBAC: Adding query filter params (role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=c7cd1e872dfd48abad8a2fc5eba06ea2) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:31.821284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:31.823373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:31.826940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5201755-207b-4b89-8294-c7f986a18051 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:31.844397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 145/276] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:31 2022] GET /identity/v3/role_assignments?user.id=c7cd1e872dfd48abad8a2fc5eba06ea2&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:31.891229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824128c-26d1-4667-992a-990470660023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:31.891928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824128c-26d1-4667-992a-990470660023 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:31.892221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824128c-26d1-4667-992a-990470660023 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:31.892504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824128c-26d1-4667-992a-990470660023 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:31.893278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824128c-26d1-4667-992a-990470660023 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:31.893591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824128c-26d1-4667-992a-990470660023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:31.895038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824128c-26d1-4667-992a-990470660023 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:31.905590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 132/277] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:31.912181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:32.004438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:32.050762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446b78-ab79-476f-830a-d911cff84ccf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:32.104710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476feb67-5da2-4a91-a3c1-f377abde8b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:32.105978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476feb67-5da2-4a91-a3c1-f377abde8b47 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.106493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476feb67-5da2-4a91-a3c1-f377abde8b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.106963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476feb67-5da2-4a91-a3c1-f377abde8b47 None admin] PATH_INFO: `/v3/users/1a45948ec9494bb7923bc60959fa6306` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.125323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476feb67-5da2-4a91-a3c1-f377abde8b47 None admin] RBAC: Authorizing `identity:get_user(user_id=1a45948ec9494bb7923bc60959fa6306)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:32.127120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476feb67-5da2-4a91-a3c1-f377abde8b47 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:32.129445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 146/278] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:31 2022] GET /identity/v3/users/1a45948ec9494bb7923bc60959fa6306 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:32.136949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824128c-26d1-4667-992a-990470660023 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:32.159439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a740d3c-73f6-440f-977e-fc79f4c46429 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.160298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a740d3c-73f6-440f-977e-fc79f4c46429 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.160769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a740d3c-73f6-440f-977e-fc79f4c46429 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.162344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 147/279] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:32.171269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.171887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.172166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.192655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:32.193862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:32.275445 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:32.280353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824128c-26d1-4667-992a-990470660023 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:32.288708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 148/280] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:32.315380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:32.337850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:32.338529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.338820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.339121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.339973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, user.id=1a45948ec9494bb7923bc60959fa6306, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:32.340285 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:32.341773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:32.349007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 133/281] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 14:54:32 2022] GET /identity/v3/role_assignments?user.id=1a45948ec9494bb7923bc60959fa6306&scope.system=all&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:32.390070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:32.446762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0fbd-6ec6-478e-a60d-f9d0c8733ada None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:32.486539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:32.487414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.487708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.487990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.501486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:32.509721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:32.510688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:32.511523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 149/282] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:32.518746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:32.658829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211f758-0354-4fa1-899a-ba9d9088bd2d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:32.713669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:32.714351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.714635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.714913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.715700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:32.716004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:32.717410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be26229-7471-4fa3-bdda-b65d5d6d11cb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:32.731676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 134/283] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:32.737412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:32.840498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f622-2813-4e5e-9eb7-a0a4f2c0ce2f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.841136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f622-2813-4e5e-9eb7-a0a4f2c0ce2f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.841640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f622-2813-4e5e-9eb7-a0a4f2c0ce2f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.843265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 135/284] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:32.848525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.849059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.849538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.882932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:32.884922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:32.907815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f359-d0d5-4b2c-81da-9d5382e01996 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:32.927529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:32.949067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:32.982186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:32.983073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:32.983389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:32.983665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] PATH_INFO: `/v3/users/8ad376cc61574690b97f947f8eec689e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:32.985513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] RBAC: Authorizing `identity:get_user(user_id=8ad376cc61574690b97f947f8eec689e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:32.986966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:32.991123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 150/285] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:32 2022] GET /identity/v3/users/8ad376cc61574690b97f947f8eec689e => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:32.995257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:33.020064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 136/286] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:33.053179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:33.186103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6ef2d-364e-4b61-8edd-6363028124b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:33.215515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c53af-f394-4363-9fd2-2c94e058e60c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:33.221978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:33.222853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:33.223169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:33.223456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:33.224671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:33.226125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:33.228228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 151/287] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:32 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:33.233904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:33.307453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:33.319594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:33.320469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:33.321393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:33.321680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:33.344208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475e231-8791-44d7-a7dc-b177dc94fb47 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:33.347982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:33.360504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:33.361370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:33.362145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 137/288] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:33.369483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:33.388009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:33.388904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:33.389192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:33.389476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/8ad376cc61574690b97f947f8eec689e/roles/72e9940f6d44456c9aa6261eb83d0c54` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:33.391514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ac761817d8b494bb2464da6990cd64b, user_id=8ad376cc61574690b97f947f8eec689e, role_id=72e9940f6d44456c9aa6261eb83d0c54)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:33.393044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:33.405641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:33.417741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 152/289] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:54:33 2022] PUT /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b/users/8ad376cc61574690b97f947f8eec689e/roles/72e9940f6d44456c9aa6261eb83d0c54 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:33.540304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73aa5c-c198-426f-8785-176b9d1f0d48 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:33.590663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:33.591377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:33.591738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:33.592020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:33.592793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:33.593104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:33.594573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:33.604162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 138/290] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:33.609646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:33.786265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf23689-980c-492b-bccc-af782ede341f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:33.808194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:33.831733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:33.832672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:33.832963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:33.833242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] PATH_INFO: `/v3/users/fc94740e2afe4f00b424ba8cd4a80da0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:33.835046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] RBAC: Authorizing `identity:get_user(user_id=fc94740e2afe4f00b424ba8cd4a80da0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:33.836854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:33.838512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 153/291] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:33 2022] GET /identity/v3/users/fc94740e2afe4f00b424ba8cd4a80da0 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:33.844179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:33.935502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:33.965762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4f6f4-e1b8-4b2e-afc2-a7977ce8f16f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:34.013810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add101a-025d-4205-b181-acba520faa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:34.014515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add101a-025d-4205-b181-acba520faa6b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.014811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add101a-025d-4205-b181-acba520faa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.015109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add101a-025d-4205-b181-acba520faa6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.092371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add101a-025d-4205-b181-acba520faa6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:34.093768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add101a-025d-4205-b181-acba520faa6b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:34.194851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:34.232238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 139/292] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:34.237722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:34.399446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db978-eafc-423f-b2a3-d9395315fe33 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:34.441225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d2e5c-e8a1-4404-b27d-466a3645317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:34.442109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2e5c-e8a1-4404-b27d-466a3645317d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.442395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2e5c-e8a1-4404-b27d-466a3645317d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.442671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2e5c-e8a1-4404-b27d-466a3645317d None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.443899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d2e5c-e8a1-4404-b27d-466a3645317d None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:34.445360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d2e5c-e8a1-4404-b27d-466a3645317d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:34.447646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 154/293] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:34 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:34.453724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add101a-025d-4205-b181-acba520faa6b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:34.578108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add101a-025d-4205-b181-acba520faa6b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:34.616568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:34.617662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.618144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.618618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.619709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=fc94740e2afe4f00b424ba8cd4a80da0) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:34.620235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:34.621932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee431-d61f-4369-98c6-ab55e74a6c1e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:34.629181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 140/294] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:34 2022] GET /identity/v3/role_assignments?user.id=fc94740e2afe4f00b424ba8cd4a80da0&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:34.841546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35189cd-4cee-43e2-893e-06d36231f169 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.842413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35189cd-4cee-43e2-893e-06d36231f169 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.842694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35189cd-4cee-43e2-893e-06d36231f169 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.844287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 155/295] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:34.849681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.850219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.850704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.869554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:34.871054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:34.891991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f2b5-1a5f-4530-856e-11d857dec8d1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.892623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f2b5-1a5f-4530-856e-11d857dec8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.893101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f2b5-1a5f-4530-856e-11d857dec8d1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.894749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 156/296] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:34.902746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:34.903378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:34.903865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:34.919806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:34.925699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:34.928002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:34.957167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 141/297] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:34.983336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:34.992367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:35.017850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 157/298] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:35.043726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.114132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9102c0-432b-48b9-b763-506666d8dc80 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.156042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.157127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246e3d1-3f98-4259-82a1-0dc61fb7c094 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.157428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.157904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.158401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.173672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:35.183916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:35.184825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:35.185614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:35.188673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 142/299] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:35.194682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.197438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.198261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.198600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.198931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.200234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:35.201875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:35.203990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 158/300] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:35.209450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.238868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:35.268608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:35.317687 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11f86-a043-4f1e-9859-f53f7adb6c59 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.320496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fdb02-e833-4039-b48f-3d034e3e7c60 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.353694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.354114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af2a0-1ba7-4114-97fd-6e1b42efe8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.354783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af2a0-1ba7-4114-97fd-6e1b42efe8d2 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.354917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.355067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af2a0-1ba7-4114-97fd-6e1b42efe8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.355374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af2a0-1ba7-4114-97fd-6e1b42efe8d2 None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.355649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.356074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af2a0-1ba7-4114-97fd-6e1b42efe8d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:35.356230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.357174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:35.357507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af2a0-1ba7-4114-97fd-6e1b42efe8d2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:35.357789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:35.359461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7ea7a-7651-4a6b-8bfb-06b02693c350 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:35.369912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 143/301] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:35.371164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9e50-cd61-4a66-923f-cbf38db967a3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.371460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9e50-cd61-4a66-923f-cbf38db967a3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.371742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9e50-cd61-4a66-923f-cbf38db967a3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.373145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 144/302] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:35.375914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9e50-cd61-4a66-923f-cbf38db967a3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.377744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 159/303] 10.222.0.45 () {60 vars in 1134 bytes} [Thu May 26 14:54:35 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:35.379382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.379677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.379962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.397976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:35.399225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:35.495127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 160/304] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:35.517818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.520374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9e50-cd61-4a66-923f-cbf38db967a3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.524429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:35.566058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.567301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.567776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.568236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] PATH_INFO: `/v3/users/6eebce4f780f4df2add9d1423865f637` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.575176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:35.585387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] RBAC: Authorizing `identity:get_user(user_id=6eebce4f780f4df2add9d1423865f637)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:35.587948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:35.590818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 145/305] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/users/6eebce4f780f4df2add9d1423865f637 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:35.597236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.661585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152127a8-869b-4ada-ac10-421d4892e334 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.713536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.714342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.714629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.714910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.718672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a9fa5-0d38-4ed6-965c-8d347b8d6408 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.726173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:35.734377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:35.735554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:35.736418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 161/306] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:35.741980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.770914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.772445 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.773065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.773599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.775200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] RBAC: Adding query filter params (role.id=72e9940f6d44456c9aa6261eb83d0c54, user.id=6eebce4f780f4df2add9d1423865f637, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:35.776151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:35.778404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:35.786700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 146/307] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/role_assignments?user.id=6eebce4f780f4df2add9d1423865f637&scope.system=all&role.id=72e9940f6d44456c9aa6261eb83d0c54 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:35.872846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:35.876320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6448-67db-4921-b10d-c4b19b9a58ce None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:35.915252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:35.915863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:35.916151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:35.916436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:35.917200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:35.917512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:35.918930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:35.928751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 162/308] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:35.935299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:35.953598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:36.060543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a391d-ae39-448a-bf05-b331d03c2ef2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:36.098074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357d11d-bfdc-4a6c-9b7e-f6b7f491af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:36.098964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357d11d-bfdc-4a6c-9b7e-f6b7f491af99 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.099281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357d11d-bfdc-4a6c-9b7e-f6b7f491af99 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.099555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357d11d-bfdc-4a6c-9b7e-f6b7f491af99 None admin] PATH_INFO: `/v3/users/1a45948ec9494bb7923bc60959fa6306` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.100762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357d11d-bfdc-4a6c-9b7e-f6b7f491af99 None admin] RBAC: Authorizing `identity:get_user(user_id=1a45948ec9494bb7923bc60959fa6306)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:36.103509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357d11d-bfdc-4a6c-9b7e-f6b7f491af99 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:36.105474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 147/309] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:35 2022] GET /identity/v3/users/1a45948ec9494bb7923bc60959fa6306 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:36.110899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:36.218373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc26e-aad3-4afc-86f3-6fe2cbdb0ecd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:36.234288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993921f-7555-4d1e-b0fb-79d3aff038da None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.234576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993921f-7555-4d1e-b0fb-79d3aff038da None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.234845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993921f-7555-4d1e-b0fb-79d3aff038da None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.237846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 148/310] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:36.247569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.248199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.248674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.263426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:36.264307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.264596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.264876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] PATH_INFO: `/v3/system/users/1a45948ec9494bb7923bc60959fa6306/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.266500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1a45948ec9494bb7923bc60959fa6306, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:36.267934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:36.268222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:36.269734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:36.279942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 163/311] 10.222.0.45 () {58 vars in 1334 bytes} [Thu May 26 14:54:36 2022] PUT /identity/v3/system/users/1a45948ec9494bb7923bc60959fa6306/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:36.352694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 149/312] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:36.375935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:36.407098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:36.493380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d3e2-8680-40cb-a4f2-c18e0e7ec564 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:36.529389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:36.530198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.530488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.530770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.542621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:36.550646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:36.551534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:36.552306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 164/313] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:36.557878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:36.572887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:36.668691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e491-6895-4211-a143-c0ee7549f63e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:36.705504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:36.706181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.706462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.706738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.707532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:36.707834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:36.709236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:36.719240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 150/314] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:36.724501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:36.817784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:36.835631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7100ec1-7745-4157-9247-0dfdd64390af None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:36.871644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:36.872746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:36.873223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:36.874117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] PATH_INFO: `/v3/users/8ad376cc61574690b97f947f8eec689e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:36.875509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] RBAC: Authorizing `identity:get_user(user_id=8ad376cc61574690b97f947f8eec689e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:36.877196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:36.878964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 165/315] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:36 2022] GET /identity/v3/users/8ad376cc61574690b97f947f8eec689e => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:36.885717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:36.967711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:36.994638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd79e-d96f-44a0-a357-e18041490889 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:37.033234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:37.034189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:37.034654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:37.035385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:37.108539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:37.109934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:37.196309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:37.217097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 151/316] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 14:54:37.222554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:37.330773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1bd2b-b44e-41a6-86df-93e0ca56318e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:37.365364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df03a-6d6f-4924-9d00-9f1a39f99220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:37.366151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df03a-6d6f-4924-9d00-9f1a39f99220 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:37.366433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df03a-6d6f-4924-9d00-9f1a39f99220 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:37.366707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df03a-6d6f-4924-9d00-9f1a39f99220 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:37.368452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401df03a-6d6f-4924-9d00-9f1a39f99220 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:37.369886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401df03a-6d6f-4924-9d00-9f1a39f99220 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:37.371972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 166/317] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:37 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:37.377323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:37.486630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432e6d4-2bac-484f-89c1-8b627b15ce3d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:37.523516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:37.524793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:37.525075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:37.525354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:37.526190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] RBAC: Adding query filter params (role.id=72e9940f6d44456c9aa6261eb83d0c54, scope.project.id=4ac761817d8b494bb2464da6990cd64b, user.id=8ad376cc61574690b97f947f8eec689e) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:37.526497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:37.527981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0b91-b54a-4fed-91e8-e0328721bd86 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:37.534434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 152/318] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:54:37 2022] GET /identity/v3/role_assignments?user.id=8ad376cc61574690b97f947f8eec689e&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=72e9940f6d44456c9aa6261eb83d0c54 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:37.803097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acd4bf-1c81-48ed-a15a-625927e60767 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:37.803443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acd4bf-1c81-48ed-a15a-625927e60767 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:37.803797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acd4bf-1c81-48ed-a15a-625927e60767 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:37.805245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 167/319] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:37.810796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:37.811362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:37.811850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:37.829355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:37.830552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:37.862177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:37.905178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 153/320] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:37.927832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acd4bf-1c81-48ed-a15a-625927e60767 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:37.954560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:38.045904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acd4bf-1c81-48ed-a15a-625927e60767 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:38.081250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50f5c2-7912-4fc5-9e26-ec46dddfb9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:38.081969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f5c2-7912-4fc5-9e26-ec46dddfb9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.082254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f5c2-7912-4fc5-9e26-ec46dddfb9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.082531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f5c2-7912-4fc5-9e26-ec46dddfb9a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.083711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50f5c2-7912-4fc5-9e26-ec46dddfb9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:38.085149 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50f5c2-7912-4fc5-9e26-ec46dddfb9a7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:38.087124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 168/321] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:38.092697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:38.191526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78710918-8543-4d3f-a637-2a546856fd84 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.191823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78710918-8543-4d3f-a637-2a546856fd84 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.192109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78710918-8543-4d3f-a637-2a546856fd84 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.193505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 169/322] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:38.196030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25adb9-0ac3-4185-b8f9-29ea4dce9da7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:38.198495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fca154-0c0a-4340-969f-771827004372 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.198788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fca154-0c0a-4340-969f-771827004372 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.199069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fca154-0c0a-4340-969f-771827004372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.215878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e0fca154-0c0a-4340-969f-771827004372 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:38.217089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0fca154-0c0a-4340-969f-771827004372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:38.233247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:38.233919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.234207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.234487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] PATH_INFO: `/v3/groups` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.235217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:38.236698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:38.255992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 154/323] 10.222.0.45 () {60 vars in 1134 bytes} [Thu May 26 14:54:38 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:38.294545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 170/324] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:38.319730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:38.352343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:38.439231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96d6ae-79bc-4619-ad43-05b5f63beed9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:38.475801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ae30-4e7e-4ce5-868a-6f8d82fdda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:38.477575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ae30-4e7e-4ce5-868a-6f8d82fdda3c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.477866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ae30-4e7e-4ce5-868a-6f8d82fdda3c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.478146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ae30-4e7e-4ce5-868a-6f8d82fdda3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.489023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ae30-4e7e-4ce5-868a-6f8d82fdda3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b8c6ae30-4e7e-4ce5-868a-6f8d82fdda3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:38.497697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:38.498643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:38.499506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 155/325] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:38.504881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fca154-0c0a-4340-969f-771827004372 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:38.531641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:38.616556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793d2cf-cbfa-4b7d-8b66-f2c37b950d31 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.616810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793d2cf-cbfa-4b7d-8b66-f2c37b950d31 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.617069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793d2cf-cbfa-4b7d-8b66-f2c37b950d31 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.619699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 156/326] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:38.625581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.626061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.626604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.629573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fca154-0c0a-4340-969f-771827004372 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:38.651713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:38.652910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:38.670451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:38.671154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.671445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.671751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.672534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:38.672846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:38.674260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:38.684300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 171/327] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:38.692091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:38.750964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 157/328] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:38.778360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:38.803547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:38.806455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:38.830463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9634-6dea-4d47-8052-5275c4451ba4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:38.875701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:38.876516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.876804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.877087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] PATH_INFO: `/v3/users/6eebce4f780f4df2add9d1423865f637` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.878881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] RBAC: Authorizing `identity:get_user(user_id=6eebce4f780f4df2add9d1423865f637)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:38.880831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:38.883309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 172/329] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:38 2022] GET /identity/v3/users/6eebce4f780f4df2add9d1423865f637 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:38.891228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:38.920033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac340f1f-38f6-4d39-b226-b07d0588cba3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:38.968921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:38.970066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:38.970495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:38.970912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:38.983668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:38.993631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:38.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:38.995441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:38.999193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 158/330] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:39.001443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:39.017690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b97d2-d1ef-423a-b167-006fdb9db644 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:39.057140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:39.058021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:39.058311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:39.058596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] PATH_INFO: `/v3/system/users/6eebce4f780f4df2add9d1423865f637/roles/72e9940f6d44456c9aa6261eb83d0c54` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:39.061062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6eebce4f780f4df2add9d1423865f637, role_id=72e9940f6d44456c9aa6261eb83d0c54)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:39.062527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:39.072817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 173/331] 10.222.0.45 () {58 vars in 1334 bytes} [Thu May 26 14:54:38 2022] PUT /identity/v3/system/users/6eebce4f780f4df2add9d1423865f637/roles/72e9940f6d44456c9aa6261eb83d0c54 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:39.108090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:39.137630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0850d6-9a62-421f-93fe-dc66a5d11907 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:39.185933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:39.187020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:39.187572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:39.188060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:39.189052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:39.189647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:39.191348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:39.203541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 159/332] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:39.211260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:39.242282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:39.346637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193895-5a65-4df9-8ae8-a8c6101d59fd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:39.385348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74f2b5-59f4-4ab5-98ac-64b4e9fb0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:39.386227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74f2b5-59f4-4ab5-98ac-64b4e9fb0847 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:39.386510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74f2b5-59f4-4ab5-98ac-64b4e9fb0847 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:39.386792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74f2b5-59f4-4ab5-98ac-64b4e9fb0847 None admin] PATH_INFO: `/v3/users/1a45948ec9494bb7923bc60959fa6306` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:39.388076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74f2b5-59f4-4ab5-98ac-64b4e9fb0847 None admin] RBAC: Authorizing `identity:get_user(user_id=1a45948ec9494bb7923bc60959fa6306)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:39.389479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74f2b5-59f4-4ab5-98ac-64b4e9fb0847 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:39.391494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 174/333] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:39 2022] GET /identity/v3/users/1a45948ec9494bb7923bc60959fa6306 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:39.396992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:39.550064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512bfb-d445-4f64-81fe-a1ee775438b1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:39.597699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:39.598739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:39.599286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:39.599792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:39.600843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] RBAC: Adding query filter params (role.id=0018fa725ee54f5dbe4d173e649d97e2, user.id=1a45948ec9494bb7923bc60959fa6306, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:39.601356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:39.603705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63402935-ca4c-4c11-9348-cccb116c0993 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:39.610299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:39.619592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 160/334] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 14:54:39 2022] GET /identity/v3/role_assignments?user.id=1a45948ec9494bb7923bc60959fa6306&scope.system=all&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:40.973897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef394239-0ed8-4b99-bde7-adf9317019c3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:40.974419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef394239-0ed8-4b99-bde7-adf9317019c3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:40.974520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef394239-0ed8-4b99-bde7-adf9317019c3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:40.976148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 175/335] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:40.982246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:40.983130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:40.983616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:41.012095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:41.013612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:41.112450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 161/336] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:41.144365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef394239-0ed8-4b99-bde7-adf9317019c3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:41.260332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:41.280292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef394239-0ed8-4b99-bde7-adf9317019c3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:41.324364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:41.325201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:41.325491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:41.325793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:41.339455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:41.347368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:41.348244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:41.349462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 176/337] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:41.354921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:41.507584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536281-6429-4ef8-9a8a-f7091f66c6ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:41.544331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:41.552667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:41.553345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:41.553628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:41.553901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:41.554652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:41.555533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:41.557529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:41.571322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 162/338] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:41.576994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:41.717703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0f324-2d75-4156-98a6-b3cc0ede58e7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:41.767748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:41.768826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:41.769329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:41.769814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:41.784406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:41.854264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:41.855714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:41.979984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 177/339] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:41.985780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:42.139766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530501c1-d3f3-4d86-a20b-ba8ac215a002 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:42.189183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e1bf-a1fe-468f-b4d1-01ce338c3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:42.190065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e1bf-a1fe-468f-b4d1-01ce338c3f50 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.190374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e1bf-a1fe-468f-b4d1-01ce338c3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.190658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e1bf-a1fe-468f-b4d1-01ce338c3f50 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.191939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072e1bf-a1fe-468f-b4d1-01ce338c3f50 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:42.193422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072e1bf-a1fe-468f-b4d1-01ce338c3f50 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:42.195543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 163/340] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:41 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:42.202697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:42.267056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:42.344264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d27177-6b4e-4ffa-a9df-b0fd07143c10 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:42.381054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02478cb6-084b-407a-b87d-92eccf862dcc None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.381793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02478cb6-084b-407a-b87d-92eccf862dcc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.382281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02478cb6-084b-407a-b87d-92eccf862dcc None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.384273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 164/341] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:42.389466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621dc6-9861-4a24-a436-45be2726de31 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.390087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:42.390335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621dc6-9861-4a24-a436-45be2726de31 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.390845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621dc6-9861-4a24-a436-45be2726de31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.390957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.391214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.391498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.398340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:42.400404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:42.402644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 178/342] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:42 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:42.409153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:42.432325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6b621dc6-9861-4a24-a436-45be2726de31 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:42.434181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b621dc6-9861-4a24-a436-45be2726de31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:42.538432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d85c1-6214-4329-9452-0de4c9228e56 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:42.538881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:42.548656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:42.571338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 165/343] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:42.580690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f235eb-f0be-42f8-a049-b5b2d16d9d4b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.581313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f235eb-f0be-42f8-a049-b5b2d16d9d4b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.581812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f235eb-f0be-42f8-a049-b5b2d16d9d4b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.583982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 166/344] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:42.590032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91389c-64e5-41e2-8cad-fef440fd45c5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.590622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91389c-64e5-41e2-8cad-fef440fd45c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.591190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91389c-64e5-41e2-8cad-fef440fd45c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.595129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:42.595906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.596202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.596489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.597436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=22d60acff64648e686937b1039fe715d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:42.597761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:42.599402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:42.607118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 179/345] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:42 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:42.612829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:42.620539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3c91389c-64e5-41e2-8cad-fef440fd45c5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:42.622202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3c91389c-64e5-41e2-8cad-fef440fd45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:42.780670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 167/346] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:42.781375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b139-3083-4816-87d7-82aa5cab4132 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:42.782563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e234-812b-4283-9683-bc57ee122deb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.782961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e234-812b-4283-9683-bc57ee122deb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.787115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e234-812b-4283-9683-bc57ee122deb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.787115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 168/347] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:42.791408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.791811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.792196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.825006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:42.826385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:42.862979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:42.864089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:42.865323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:42.865759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:42.889741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:42.906800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:42.907991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:42.908937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:42.916351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 180/348] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:42.917446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:42.953946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 169/349] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:42.955347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:42.956025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.031972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.046650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab33b69-3ba4-4d66-8694-562c5aa509f4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.091680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19320d-da1b-436c-ad2d-3aa4cb72b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.092489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19320d-da1b-436c-ad2d-3aa4cb72b57a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.092772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19320d-da1b-436c-ad2d-3aa4cb72b57a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.093305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19320d-da1b-436c-ad2d-3aa4cb72b57a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.105105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19320d-da1b-436c-ad2d-3aa4cb72b57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:43.107750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58870c-0f4a-4f53-bf5b-308389bf3c14 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8f19320d-da1b-436c-ad2d-3aa4cb72b57a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:43.113333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:43.114323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:43.115167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 181/350] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:43.116303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488f9c-c31f-47c9-bf7b-e7befef5978f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.116303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488f9c-c31f-47c9-bf7b-e7befef5978f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.116553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488f9c-c31f-47c9-bf7b-e7befef5978f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.123154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 182/351] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:43.123538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2488f9c-c31f-47c9-bf7b-e7befef5978f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.159938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.160909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.161426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.161872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.162949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:43.163443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:43.165755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:43.175360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 170/352] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:43.176566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.233146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.245473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2488f9c-c31f-47c9-bf7b-e7befef5978f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.288457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3e229-901a-4f35-9604-ce1eccf3ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.289795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3e229-901a-4f35-9604-ce1eccf3ec79 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.290234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3e229-901a-4f35-9604-ce1eccf3ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.290739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3e229-901a-4f35-9604-ce1eccf3ec79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.302305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3e229-901a-4f35-9604-ce1eccf3ec79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-26a3e229-901a-4f35-9604-ce1eccf3ec79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:43.310663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:43.311612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 14:54:43.312393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:43.312991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5493-ccb7-4373-b6ce-559e0bcb81b6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.313060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 183/353] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:43.313627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.313841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.315118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.331447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.336634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:43.338090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:43.370070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.370753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.371044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.371365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.372129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:43.372464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:43.375159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:43.388834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 171/354] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:43.390093 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.447110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 184/355] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:43.447110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.536999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dec94-b385-49d1-b2ab-d944e5de9ffd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.547559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.565289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9433708-52a9-4e6c-b130-90e043de27fc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.575437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.577512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.578029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.578546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.620826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.621511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.621800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.622096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.622850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:43.623188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:43.624587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:43.634617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.634782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 185/356] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:43.640959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.669324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:43.671673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:43.765350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5782e4-55ae-4208-a1c7-22ad31b6378f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.801685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 172/357] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:43.801685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:43.811577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3104-3be1-4e2e-beb6-67ce21a4c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.812367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3104-3be1-4e2e-beb6-67ce21a4c1fd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.812661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3104-3be1-4e2e-beb6-67ce21a4c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.812946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3104-3be1-4e2e-beb6-67ce21a4c1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.828045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.893233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:43.903730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff3104-3be1-4e2e-beb6-67ce21a4c1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:43.905841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff3104-3be1-4e2e-beb6-67ce21a4c1fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:43.934822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99456-85f1-4369-af90-f220c02c2296 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:43.982009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:43.983167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:43.983578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:43.984010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:43.998685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:44.009102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:44.014812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 173/358] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:44.015717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.036561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 186/359] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:44.038591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316732-5acf-4ba3-941c-4aa69e62e8c7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.038591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316732-5acf-4ba3-941c-4aa69e62e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.038591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316732-5acf-4ba3-941c-4aa69e62e8c7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.042187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 187/360] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:44.042187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316732-5acf-4ba3-941c-4aa69e62e8c7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.108981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:44.151786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a839-a9ff-4a7f-8dc9-9f0f4d047cad None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.186724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316732-5acf-4ba3-941c-4aa69e62e8c7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.192028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:44.201904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.202774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.203154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.203443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] PATH_INFO: `/v3/users/6eebce4f780f4df2add9d1423865f637` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.204889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6eebce4f780f4df2add9d1423865f637)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.206366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.211799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 174/361] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/users/6eebce4f780f4df2add9d1423865f637 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.213004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.230166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.231034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.232205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.232493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.233984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.235952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.237829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 188/362] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.239027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.339904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992693b-30e6-437a-b94a-abad6d6214c2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.366025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063311d-aa5d-4cc1-90d7-50e8edf68f43 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.378664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:44.390554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.391273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.391565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.391836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.392593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:44.392901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.394280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008474a-7f6c-4846-8503-07783d2d49c1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.405331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 175/363] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.410785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.411483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.411681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.411791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.411943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.412051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.412247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.413546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.415000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.417073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 189/364] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.418597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.429656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:44.431057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:44.498864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:44.519517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 176/365] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:44.520458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.551355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375615-92a9-467b-88ca-f41a8adebf98 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.605633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.606310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.606595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.606877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.607755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] RBAC: Adding query filter params (role.id=72e9940f6d44456c9aa6261eb83d0c54, user.id=6eebce4f780f4df2add9d1423865f637, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:44.608071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.609610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.624304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 190/366] 10.222.0.45 () {56 vars in 1308 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/role_assignments?user.id=6eebce4f780f4df2add9d1423865f637&scope.system=all&role.id=72e9940f6d44456c9aa6261eb83d0c54 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.626675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.668135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71340278-d45f-4a77-94af-6a0898f1efa1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.673865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:44.727844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.729849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.731364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.731872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.733444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.735174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.738215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 177/367] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.739849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.776109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f26b7-20c4-4d5c-be3e-ebd21353e082 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.818285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.819023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.819347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.819624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.835066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:44.895785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c0d74-3fc9-426d-82d0-ee58f3677ebd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:44.917801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.919297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.946507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:44.947413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:44.947700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:44.947976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:44.949618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:44.951156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:44.952968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 178/368] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:44.953637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:44.978101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.052687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 191/369] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:45.053409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.087424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e1d26-fc8e-414f-a05a-085e07490186 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.134386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.147690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.148516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.149258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.149997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.162575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:45.170462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:45.171424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:45.172185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:45.173240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 179/370] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:45.173838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.199059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a18cd5-2d03-4244-a20f-436171527a09 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.241720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.243748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.244059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.244342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.245468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=22d60acff64648e686937b1039fe715d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:45.245784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.247894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:45.253476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.256896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 192/371] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:45.260481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.329758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24edeb-c7b7-464f-a11e-c930032cedbd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.384568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.385605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.386099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.386595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.387753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=4ac761817d8b494bb2464da6990cd64b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:45.388347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.390066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:45.396746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 180/372] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:45.397525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.402572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01104b2-6522-4de4-8973-8d98e6765cda None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.449656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd58a5-bbf0-4e87-b236-fc60512ae044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.450667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd58a5-bbf0-4e87-b236-fc60512ae044 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.451047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd58a5-bbf0-4e87-b236-fc60512ae044 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.451371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd58a5-bbf0-4e87-b236-fc60512ae044 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.452697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd58a5-bbf0-4e87-b236-fc60512ae044 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.454331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd58a5-bbf0-4e87-b236-fc60512ae044 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:45.456673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 193/373] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:45.458254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb557e9-9b9e-4fa1-b866-a5f49f12f9da None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.458547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb557e9-9b9e-4fa1-b866-a5f49f12f9da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.458834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb557e9-9b9e-4fa1-b866-a5f49f12f9da None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.464582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 194/374] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:45.465688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb557e9-9b9e-4fa1-b866-a5f49f12f9da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.469904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.537913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35209d-b76c-49ca-84a9-5dba3ee4127b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.560889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.581829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.582820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.583328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.583815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.584796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:45.585367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.587175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d961c-eb56-4c0a-88ba-0d8505bf3949 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:45.598109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 181/375] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:45.599792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.600264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.600739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.609991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb557e9-9b9e-4fa1-b866-a5f49f12f9da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.622132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:45.623802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:45.653658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.654578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.654933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.655321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.656570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.658143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:45.660438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 195/376] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:45.661291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.709945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 182/377] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:45.711977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.762984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.794214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc9c6-eb17-4403-90b0-0014ee2ea7ba None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.825471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f701b2c-5fe8-4437-9dfe-1d759bf32642 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:45.835672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.837086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.837449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.837800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.841753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:45.868076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:45.869231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:45.869741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:45.870305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:45.871384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=4ac761817d8b494bb2464da6990cd64b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:45.871909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.873849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:45.880467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 183/378] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:45.881510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:45.973825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:45.975261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:46.079332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85362225-6e23-40fb-96c3-b60bce8b854c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:46.097671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:46.147455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:46.150830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:46.151136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:46.151422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:46.163649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:46.174333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:46.175357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:46.176146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 184/379] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:46.184061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.212057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 196/380] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:46.213201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.283331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:46.349628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3613dd-8a7f-43e1-88ff-74d6ea47df17 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:46.416376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:46.417069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:46.417357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:46.417640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:46.418405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:46.418714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:46.420157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:46.443735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 185/381] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:46.448820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.450966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057e42a-ffd9-4f14-9f75-659135322d40 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:46.503496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:46.548787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:46.550036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:46.550525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:46.551004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] PATH_INFO: `/v3/projects/e013887c316445b783792ef3f307427d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:46.554046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] RBAC: Authorizing `identity:get_project(project_id=e013887c316445b783792ef3f307427d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:46.556048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:46.562601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 197/382] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:46 2022] GET /identity/v3/projects/e013887c316445b783792ef3f307427d => generated 344 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:46.566577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.635636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfece6e-256e-4fcb-bd2a-7bcc110edbdb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:46.692410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:46.693398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:46.693690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:46.693971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:46.695909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:46.697784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:46.703224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 186/383] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:46 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:46.704944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.721915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a430ac-bf8a-4a66-b4c1-2327ad681487 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:46.727440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:46.767171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:46.768413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:46.768931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:46.769474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] PATH_INFO: `/v3/groups/72dde947b65941d2acc9bc6a7e1c4bcd` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:46.775698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] RBAC: Authorizing `identity:get_group(group_id=72dde947b65941d2acc9bc6a7e1c4bcd)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:46.777441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:46.780558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 198/384] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:46 2022] GET /identity/v3/groups/72dde947b65941d2acc9bc6a7e1c4bcd => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:46.789521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.845881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:46.850456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde2fb-f3d2-49a9-8dbb-1f0b306aeaa3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:46.893305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:46.894926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:46.895855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:46.896367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:46.897811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:46.899559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:46.901943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 187/385] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:46 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:46.907821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:46.945202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d1ad4-ecd4-4c6d-b51d-325f9da7b571 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:47.011854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:47.012542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:47.012833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:47.013125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:47.014052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] RBAC: Adding query filter params (group.id=72dde947b65941d2acc9bc6a7e1c4bcd, role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e013887c316445b783792ef3f307427d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:47.014373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:47.015852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a55c-c387-4bcb-866b-1a0cf6251fe3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:47.026005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 199/386] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:46 2022] GET /identity/v3/role_assignments?group.id=72dde947b65941d2acc9bc6a7e1c4bcd&scope.project.id=e013887c316445b783792ef3f307427d&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:47.031840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afcd5a-a743-462c-a21c-c1cf6f93649a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:47.086835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288301cd-336d-4fae-b5c1-4738281064f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:47.088162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288301cd-336d-4fae-b5c1-4738281064f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:47.088663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288301cd-336d-4fae-b5c1-4738281064f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:47.089169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288301cd-336d-4fae-b5c1-4738281064f2 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d/groups/c413df10416d4ec99c7bef322f75195f/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:47.091500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288301cd-336d-4fae-b5c1-4738281064f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=22d60acff64648e686937b1039fe715d, group_id=c413df10416d4ec99c7bef322f75195f, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:47.093204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288301cd-336d-4fae-b5c1-4738281064f2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:47.120230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 188/387] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 14:54:46 2022] PUT /identity/v3/projects/22d60acff64648e686937b1039fe715d/groups/c413df10416d4ec99c7bef322f75195f/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:54:48.086916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378c8af-1976-4673-979c-2cf36ebf28e4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.087470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378c8af-1976-4673-979c-2cf36ebf28e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.087699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378c8af-1976-4673-979c-2cf36ebf28e4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.089530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 200/388] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:48.094987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e60f-9d3f-49f5-993b-a9695796f365 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.096000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e60f-9d3f-49f5-993b-a9695796f365 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.096523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e60f-9d3f-49f5-993b-a9695796f365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.121283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e238e60f-9d3f-49f5-993b-a9695796f365 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:48.122868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e238e60f-9d3f-49f5-993b-a9695796f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:48.150467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:48.208258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 189/389] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:48.243684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378c8af-1976-4673-979c-2cf36ebf28e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:48.282196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:48.336104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f6ef-b145-4dd4-affd-86704d32d3b4 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.336976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f6ef-b145-4dd4-affd-86704d32d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.337266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f6ef-b145-4dd4-affd-86704d32d3b4 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.338904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 190/390] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:48.344445 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.344730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.345011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.360056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378c8af-1976-4673-979c-2cf36ebf28e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:48.388131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:48.389315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:48.398694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:48.399547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.399835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.400117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.411372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:48.422555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:48.423510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:48.424699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 201/391] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:48.430297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:48.525959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 191/392] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:48.536259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:48.547405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311dfd7-f9c9-432f-b701-fe3a6905a1ba None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:48.556177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:48.583987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:48.584674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.584961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.585241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.586091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:48.586461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:48.587872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:48.597467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 202/393] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:48.602307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:48.731480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:48.748758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce65f-a1a9-4f76-8875-42bcc07e10de None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:48.760449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a28c-80c0-4cf2-9c84-c49336bb8b65 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:48.787354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:48.788221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.788509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.788791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.790285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:48.791763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:48.793412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 203/394] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:48 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:48.798995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:48.829445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:48.887957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:48.888709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.889001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.889284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.913788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b34fd-b05c-4556-8406-2725e7665e86 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:48.932044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:48.942606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:48.943496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:48.944279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 192/395] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:48.952195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:48.953067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:48.953355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:48.953639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:48.954901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:48.956034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:48.956444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:48.958479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 204/396] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:48 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:48.965843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.072666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:49.087479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a735b-e45d-46df-859f-dc8da4ebca60 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.129213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8ebf-e454-40cc-b5db-c05ad0415d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.130343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8ebf-e454-40cc-b5db-c05ad0415d09 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.131017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8ebf-e454-40cc-b5db-c05ad0415d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.131328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8ebf-e454-40cc-b5db-c05ad0415d09 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d/groups/c413df10416d4ec99c7bef322f75195f/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.135874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8ebf-e454-40cc-b5db-c05ad0415d09 None admin] RBAC: Authorizing `identity:create_grant(project_id=22d60acff64648e686937b1039fe715d, group_id=c413df10416d4ec99c7bef322f75195f, role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:49.137307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8ebf-e454-40cc-b5db-c05ad0415d09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:49.137418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33b47-adfc-431a-a6d4-83c00536da90 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.156585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 205/397] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 14:54:48 2022] PUT /identity/v3/projects/22d60acff64648e686937b1039fe715d/groups/c413df10416d4ec99c7bef322f75195f/roles/a35ac9e7d95640e99df8d5940692e128 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:49.158284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951c97-ed3e-4066-a98e-2322b23faf51 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.158577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951c97-ed3e-4066-a98e-2322b23faf51 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.158948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951c97-ed3e-4066-a98e-2322b23faf51 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.165863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 206/398] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:49.168154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.168449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.168729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.190691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:49.192131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:49.210519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.211889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.212178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.212616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.213394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:49.213706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:49.219498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:49.237630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 193/399] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:49.243450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.265989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:49.283879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 207/400] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:49.313709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.427541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:49.446574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cdd8-daeb-4249-a26d-ed0d38782b43 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.454617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c21e-1196-49fd-b7fc-ef75d9e825be None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.500695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.502140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.502522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.502945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.504478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:49.505911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.506156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:49.506916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.507331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.508339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.508708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 194/401] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:49 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:49.514275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.544591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:49.562835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:49.563811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:49.564591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 208/402] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:49.589760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.678234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:49.722785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832f3d-99b1-47dd-9558-f35bf9d38962 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.766186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.767117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.767493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.767773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.769191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:49.770698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:49.773508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 195/403] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:49 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:49.784431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.793671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff528-50e4-4014-8b18-4df52a6933db None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.857096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.857778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.858061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.858335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.859110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:49.859418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:49.860796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:49.881437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 209/404] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:49.888067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:49.893536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:49.951418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f064-f0ed-4f8e-8eb0-7ec8957c06c9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:49.986496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bc8f9-1257-46a7-b885-646315248e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:49.987527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bc8f9-1257-46a7-b885-646315248e5a None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:49.987820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bc8f9-1257-46a7-b885-646315248e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:49.988104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bc8f9-1257-46a7-b885-646315248e5a None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b/groups/c413df10416d4ec99c7bef322f75195f/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:49.990209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bc8f9-1257-46a7-b885-646315248e5a None admin] RBAC: Authorizing `identity:create_grant(project_id=4ac761817d8b494bb2464da6990cd64b, group_id=c413df10416d4ec99c7bef322f75195f, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:49.991827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bc8f9-1257-46a7-b885-646315248e5a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.007106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 196/405] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 14:54:49 2022] PUT /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b/groups/c413df10416d4ec99c7bef322f75195f/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:54:50.009114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a736-9761-4158-9859-aaee1243dd51 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.009458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a736-9761-4158-9859-aaee1243dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.009744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a736-9761-4158-9859-aaee1243dd51 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.011201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 197/406] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:50.016784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.017070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.017410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.025128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.038909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1f91-66ca-4a5c-8284-58360e543c0a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.039238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:50.047133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:50.084687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2ba93-f4eb-40b4-9a44-bd0c7037902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.085575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ba93-f4eb-40b4-9a44-bd0c7037902e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.086429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ba93-f4eb-40b4-9a44-bd0c7037902e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.086888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ba93-f4eb-40b4-9a44-bd0c7037902e None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.088313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2ba93-f4eb-40b4-9a44-bd0c7037902e None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:50.089786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2ba93-f4eb-40b4-9a44-bd0c7037902e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.091898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 210/407] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:49 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:50.093325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f6786-b13c-4e0d-a854-dc56ce2260ac None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.093621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f6786-b13c-4e0d-a854-dc56ce2260ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.093902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f6786-b13c-4e0d-a854-dc56ce2260ac None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.095301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 211/408] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:50.103491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.103825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.104053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.123672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:50.125054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:50.130730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 198/409] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:50.131771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.205219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.210297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 212/410] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:50.219728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.248878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350561c-dfda-40a3-95ed-94e679053d57 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.290817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.291738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.292093 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.292417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.294161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:50.295972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.298435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 199/411] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:50.299620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.319436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.356144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cbd3e-4e40-478d-9cfc-65d9d977a05b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.403355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.404804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.405464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.406242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.422580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:50.422772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352ddaa-c6fa-4300-b903-6c6144041cf0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:50.433562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:50.434479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:50.435400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:50.436777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 213/412] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:50.437267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.466301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.467018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.467359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.467692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.480817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:50.490916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:50.491878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:50.492911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:50.497352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 200/413] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:50.498214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.520273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.577157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.588498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bef85-2229-4d92-843f-25d271914bb3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.625287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcc2e-922f-48b3-9aa6-645544ae7343 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.631765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.633361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.633652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.633933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b/groups/c413df10416d4ec99c7bef322f75195f/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.636379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ac761817d8b494bb2464da6990cd64b, group_id=c413df10416d4ec99c7bef322f75195f, role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:50.637842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.653483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 214/414] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 14:54:50 2022] PUT /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b/groups/c413df10416d4ec99c7bef322f75195f/roles/a35ac9e7d95640e99df8d5940692e128 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:50.654373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.668459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.669533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.670068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.670589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.671589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:50.672224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:50.673872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.684431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 201/415] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:50.704627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.793085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556c65-5ea8-4dce-a951-76128b870f84 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.817005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.844489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.845186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.845471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.846897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.847716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:50.848030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:50.849435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.877154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 215/416] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:50.888169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:50.917422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd929ff-a465-4299-af3a-7e75e5607e6a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:50.945439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:50.959802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:50.961014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:50.961548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:50.962241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] PATH_INFO: `/v3/groups/72dde947b65941d2acc9bc6a7e1c4bcd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:50.963788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] RBAC: Authorizing `identity:get_group(group_id=72dde947b65941d2acc9bc6a7e1c4bcd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:50.965764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:50.968075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 202/417] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/groups/72dde947b65941d2acc9bc6a7e1c4bcd => generated 229 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:50.973251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:51.011442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d8504-2eb7-460d-af57-50fbb8ca4cb0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:51.064882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:51.065785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:51.066217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:51.066638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:51.103823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bdeef-a04b-4176-9b1e-bc07fec7a075 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:51.144995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:51.146133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:51.147471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:51.147767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] PATH_INFO: `/v3/projects/e013887c316445b783792ef3f307427d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:51.150472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] RBAC: Authorizing `identity:get_project(project_id=e013887c316445b783792ef3f307427d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:51.152123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:51.154805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 203/418] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/projects/e013887c316445b783792ef3f307427d => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:51.158451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:51.162045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:51.193824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:51.195684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:51.233874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:51.284271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70725bda-ab58-44cf-851e-f39cb487987d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:51.323519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:51.324928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:51.325421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:51.325904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] PATH_INFO: `/v3/projects/e013887c316445b783792ef3f307427d/groups/72dde947b65941d2acc9bc6a7e1c4bcd/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:51.328274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e013887c316445b783792ef3f307427d, group_id=72dde947b65941d2acc9bc6a7e1c4bcd, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:51.329957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:51.348400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 204/419] 10.222.0.45 () {58 vars in 1442 bytes} [Thu May 26 14:54:51 2022] PUT /identity/v3/projects/e013887c316445b783792ef3f307427d/groups/72dde947b65941d2acc9bc6a7e1c4bcd/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:54:51.384447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 216/420] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 14:54:51.389953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:51.559228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119abc28-87bb-46f1-82d9-3caacbfff6c8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:51.583525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:51.600432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:51.601707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:51.602385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:51.602965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:51.605082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:51.606643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:51.609322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 205/421] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:51 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:51.615627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:51.737431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:51.761952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef120e-b61e-4e5c-92ac-439e8a360fb0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:51.801211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3e302-a6b0-4090-8e18-dee6b7fb6c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:51.802411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e302-a6b0-4090-8e18-dee6b7fb6c58 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:51.802900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e302-a6b0-4090-8e18-dee6b7fb6c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:51.803464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e302-a6b0-4090-8e18-dee6b7fb6c58 None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:51.805146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3e302-a6b0-4090-8e18-dee6b7fb6c58 None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:51.806936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3e302-a6b0-4090-8e18-dee6b7fb6c58 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:51.809231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 217/422] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:51 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:51.814792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:51.970043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0013013-bef2-4e14-8c1a-6c0f9fb71752 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:52.009588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:52.010253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.010585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.010868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.011741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=22d60acff64648e686937b1039fe715d) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:52.012056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:52.013523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:52.018828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5230b3-783c-4a7e-837a-736116723193 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.021292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5230b3-783c-4a7e-837a-736116723193 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.021292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5230b3-783c-4a7e-837a-736116723193 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.021292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 218/423] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:52.024061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 206/424] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:51 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:52.038382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.038940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.039409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.063605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:52.064839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:52.169318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 219/425] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:52.212789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:52.290859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:52.356401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05f2ca-b40e-4560-a961-7220441672db None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:52.396292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3173b0-1db6-459b-b3af-ef74cefeaf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:52.397405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3173b0-1db6-459b-b3af-ef74cefeaf69 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.397878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3173b0-1db6-459b-b3af-ef74cefeaf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.398381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3173b0-1db6-459b-b3af-ef74cefeaf69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.411647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3173b0-1db6-459b-b3af-ef74cefeaf69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5d3173b0-1db6-459b-b3af-ef74cefeaf69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:52.420734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:52.421627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:52.422410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:52.425530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 207/426] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:52.431172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:52.516550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:52.525435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74a6e-93f1-4c8c-a653-7a8a62cf771f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.525748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74a6e-93f1-4c8c-a653-7a8a62cf771f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.525997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74a6e-93f1-4c8c-a653-7a8a62cf771f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.527899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 208/427] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:52.533380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.533673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.533952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.545364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44dd05-6052-4568-8d2a-47944218cca9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:52.568396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:52.569764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:52.593493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:52.594165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.594447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.594725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.595785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:52.595785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:52.597172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:52.611233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 220/428] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:52.619456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:52.660204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 209/429] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:52.700610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:52.749985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a416-daac-445b-a4d8-8e06b8cb0f90 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:52.755934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:52.796406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:52.797000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.797284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.797559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.816181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:52.828994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7ce4e-ad43-4e08-8699-1bde6d1c52e5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:52.875877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:52.877396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:52.878104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:52.878556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:52.892447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:52.897904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:52.898917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:52.904822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:52.905882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 14:54:52.906653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:52.910761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 210/430] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:52.916397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.037692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 221/431] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:53.044785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.064850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec09d0-4d07-4b51-99fe-cf1a3d2c6d1a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.066573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.094974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.112150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.112826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.113112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.113493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.114140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:53.114449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.115858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.129306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 211/432] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:54:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:53.130602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.172712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882313-0a64-4565-86ac-6c41707f474e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.224589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.225945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.226499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.227200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] PATH_INFO: `/v3/projects/22d60acff64648e686937b1039fe715d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.229054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=22d60acff64648e686937b1039fe715d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.231158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.238607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 222/433] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/projects/22d60acff64648e686937b1039fe715d => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:53.239106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.254069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5a451-4def-42c6-ac64-40a97da1faa9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.305361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b20f2e-366e-415b-826e-5beb820623f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.307023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b20f2e-366e-415b-826e-5beb820623f8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.307484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b20f2e-366e-415b-826e-5beb820623f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.307910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b20f2e-366e-415b-826e-5beb820623f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.346131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.374574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d806a-7436-4709-9173-2f3442ae3cc6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.386862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b20f2e-366e-415b-826e-5beb820623f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.388530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b20f2e-366e-415b-826e-5beb820623f8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.389885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.421733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.423022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.423866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.424565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.425910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.428508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.430358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 223/434] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:53.436551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.497955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 212/435] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:53.499401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc37dbb-0224-4abc-b347-2cce99424341 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.499696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc37dbb-0224-4abc-b347-2cce99424341 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.499974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc37dbb-0224-4abc-b347-2cce99424341 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.501404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 213/436] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:53.503104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc37dbb-0224-4abc-b347-2cce99424341 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.555975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f819a-61fa-411b-8483-9ad4d0b6eeef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.570963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.592799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.593744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.594100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.594449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.595321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=22d60acff64648e686937b1039fe715d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:53.595778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.597279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9be47-deb6-47c2-bb20-acff22ef9ff2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.603613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 224/437] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=22d60acff64648e686937b1039fe715d&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:53.604620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.604912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.605193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.620906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc37dbb-0224-4abc-b347-2cce99424341 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.624104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:53.625436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:53.667071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.671674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.672939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.673456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.673936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.676179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.678320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.682080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 214/438] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:53.687972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.719568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 225/439] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:53.736628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.807325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d2a7-db51-4196-830e-462ffed82d55 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.848364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:53.854419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.855361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.855635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.855948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.857244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:53.858721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:53.859690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b58eb-3bc2-442c-80e3-8b9fc7b7f90b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:53.865352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 215/440] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:53.866391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:53.915503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:53.916347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:53.916631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:53.916910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:53.942384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:53.954505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:53.955600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:53.956401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 226/441] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:53.963682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.001437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323b178-674e-4ce0-8a4a-57539f4236fd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.005836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.050336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.050336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.050668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.051532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.051921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=0018fa725ee54f5dbe4d173e649d97e2, scope.project.id=4ac761817d8b494bb2464da6990cd64b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:54.052228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.053695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372db57-0716-4753-aba9-ea4cff5c1b8d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.060995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 216/442] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=0018fa725ee54f5dbe4d173e649d97e2 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:54.097907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5bb0-a754-4189-9f4c-8c2f0e9b1ee0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.109622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea24dd2-100f-442a-9588-73df96a619aa None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.109811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea24dd2-100f-442a-9588-73df96a619aa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.110096 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea24dd2-100f-442a-9588-73df96a619aa None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.111645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 217/443] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:54:54.117056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a972-707a-4681-aa96-536039f0937b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.117824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a972-707a-4681-aa96-536039f0937b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.118117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a972-707a-4681-aa96-536039f0937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.136554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3a29a972-707a-4681-aa96-536039f0937b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:54.137787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3a29a972-707a-4681-aa96-536039f0937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:54.146686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.147493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.147784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.148068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.149367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:54.149682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.151892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.168034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 227/444] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:54:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:54.173812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.209319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.221639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 218/445] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:54.246314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a972-707a-4681-aa96-536039f0937b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.286480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.295056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41bc69-b2a0-41bc-b3bb-f2021e7eec74 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.338273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.338927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.339249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.339529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.366569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a972-707a-4681-aa96-536039f0937b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.408473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.409279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.409825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.410104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.420707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.422150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.423420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:54:54.432985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:54.433916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:54.434704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 219/446] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:54:54.441759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.503059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.525172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.533260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 228/447] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 14:54:54.539152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.550930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4c79-3b19-42c5-a0e9-81619e6a0033 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.585446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.586205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.586492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.586770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.587557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:54.587869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.589271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.597268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 220/448] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:54.602902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.642945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd56a54-ba43-44ed-a936-974a8656e208 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.676210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.677057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.677341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.677616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] PATH_INFO: `/v3/projects/4ac761817d8b494bb2464da6990cd64b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.678823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] RBAC: Authorizing `identity:get_project(project_id=4ac761817d8b494bb2464da6990cd64b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.681475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.683348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 229/449] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/projects/4ac761817d8b494bb2464da6990cd64b => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:54.688737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.706091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2868-ccd4-4b8d-8e4d-ffa7431198dd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.722208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.749707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.749955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.750367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.750654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.751001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.790970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e701-0963-4ef9-962d-6ec5e3a3184f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.820729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.822186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.824139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.824990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.825266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.825539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] PATH_INFO: `/v3/groups/c413df10416d4ec99c7bef322f75195f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.826699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] RBAC: Authorizing `identity:get_group(group_id=c413df10416d4ec99c7bef322f75195f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.828143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.829758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 230/450] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/groups/c413df10416d4ec99c7bef322f75195f => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:54.835352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.921225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 221/451] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:54:54.926471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:54.935356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3a60-cd18-4bfb-941d-d43d9b35207d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:54.943605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.965122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:54.971242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:54.971996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:54.972278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:54.972551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:54.973374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] RBAC: Adding query filter params (group.id=c413df10416d4ec99c7bef322f75195f, role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=4ac761817d8b494bb2464da6990cd64b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:54.973704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:54.975143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:54.981149 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 231/452] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/role_assignments?group.id=c413df10416d4ec99c7bef322f75195f&scope.project.id=4ac761817d8b494bb2464da6990cd64b&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:55.032087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4fc59-fb6d-40f7-b242-ab3a33b4e0f3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:55.069701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:55.071352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:55.071644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:55.071926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] PATH_INFO: `/v3/projects/e013887c316445b783792ef3f307427d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:55.073210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] RBAC: Authorizing `identity:get_project(project_id=e013887c316445b783792ef3f307427d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:55.074765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:55.076581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 222/453] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:54:54 2022] GET /identity/v3/projects/e013887c316445b783792ef3f307427d => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:55.082327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:55.187894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36904481-ff4b-40c0-8cd1-6238a9f7bfb5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:55.222998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bdba4-c414-4857-872f-41c0240db261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:55.223884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bdba4-c414-4857-872f-41c0240db261 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:55.224169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bdba4-c414-4857-872f-41c0240db261 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:55.224448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bdba4-c414-4857-872f-41c0240db261 None admin] PATH_INFO: `/v3/groups/72dde947b65941d2acc9bc6a7e1c4bcd` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:55.225598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bdba4-c414-4857-872f-41c0240db261 None admin] RBAC: Authorizing `identity:get_group(group_id=72dde947b65941d2acc9bc6a7e1c4bcd)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:55.227131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bdba4-c414-4857-872f-41c0240db261 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:55.228758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 232/454] 10.222.0.45 () {56 vars in 1180 bytes} [Thu May 26 14:54:55 2022] GET /identity/v3/groups/72dde947b65941d2acc9bc6a7e1c4bcd => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:55.234529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:55.322249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:55.337958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0305-ef03-4e42-9d99-25a7879c2382 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:55.371378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:55.372103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:55.372317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:55.372592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:55.373426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] RBAC: Adding query filter params (group.id=72dde947b65941d2acc9bc6a7e1c4bcd, role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e013887c316445b783792ef3f307427d) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:55.373734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:55.375194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e266c-dc6e-4aa9-a657-13096abd5fe6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:55.380885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 223/455] 10.222.0.45 () {56 vars in 1376 bytes} [Thu May 26 14:54:55 2022] GET /identity/v3/role_assignments?group.id=72dde947b65941d2acc9bc6a7e1c4bcd&scope.project.id=e013887c316445b783792ef3f307427d&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:57.985648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9b401-6a3d-4566-b890-2a49d04ea70a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:57.986678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9b401-6a3d-4566-b890-2a49d04ea70a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:57.987205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9b401-6a3d-4566-b890-2a49d04ea70a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:57.989089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 233/456] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:57.994999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37533-0d81-42ea-8594-dc5c791bfc7a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:57.995472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37533-0d81-42ea-8594-dc5c791bfc7a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:57.995662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37533-0d81-42ea-8594-dc5c791bfc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.018793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0da37533-0d81-42ea-8594-dc5c791bfc7a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:58.019998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0da37533-0d81-42ea-8594-dc5c791bfc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:58.113579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 224/457] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:58.164848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9b401-6a3d-4566-b890-2a49d04ea70a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.171963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ab6b-357e-439c-bea3-b412bd6fa732 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.176641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ab6b-357e-439c-bea3-b412bd6fa732 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.177200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ab6b-357e-439c-bea3-b412bd6fa732 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.178863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 225/458] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:58.195917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc2f4-f790-4937-b4cb-15464212cd88 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.196678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc2f4-f790-4937-b4cb-15464212cd88 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.197173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc2f4-f790-4937-b4cb-15464212cd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.223254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f28dc2f4-f790-4937-b4cb-15464212cd88 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:58.225176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f28dc2f4-f790-4937-b4cb-15464212cd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:58.310182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:58.358170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 226/459] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:54:58.359839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0968-61f8-4b5c-ab25-995f23f2c8fb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.360265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0968-61f8-4b5c-ab25-995f23f2c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.360677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0968-61f8-4b5c-ab25-995f23f2c8fb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.366622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 227/460] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:58.368745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.369189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.369619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.388077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:58.388902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9b401-6a3d-4566-b890-2a49d04ea70a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:58.389670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:58.392252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:58.435416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:58.436529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.436927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.437466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.449831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:58.451351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:54:58.472603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:58.473695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:58.474744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:54:58.474744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:54:58.474744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:58.474744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:58.477139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 234/461] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:58.478404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.480707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 228/462] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:58.486858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.608669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9d201-87f3-4ec3-ae8e-70f4b2f17e8b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:58.615940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79844308-93cc-4f28-9446-03629d31ede5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:58.624756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:58.648813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:58.649989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.650481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.650981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.654815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:58.655538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.655829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.656112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.656876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:58.657188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:58.658607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:58.665572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:58.666447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:58.667619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:58.674027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 229/463] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:58.675018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:54:58.687910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:58.688772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:58.689678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:54:58.689678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:54:58.689678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:58.689678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:54:58.691661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 235/464] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:58.692652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.791935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28064ae2-9660-44a3-b75d-69d1d3024a15 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:58.805356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2307bbb-7628-40e4-a271-b4bd808f2fb7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:58.830137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:58.831122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.831350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.831636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.843300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:58.844248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:58.844355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:58.844851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:58.845331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:58.845801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:58.846728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:58.848397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:54:58.867810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:58.868725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:58.869559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:54:58.869559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:54:58.869559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:58.869559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:58.873126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 236/466] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:58 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:58.873350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 230/466] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:58.874288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.883306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:58.927414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:58.941577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:59.008556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebbac2-f39f-495d-a06b-e9752fc3e5fe None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:59.021486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceaa73-2681-4eb3-beaf-079fea2f32f7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:59.062379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:59.062589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:59.063201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.063502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.063785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.064227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.064672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:59.064922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.065029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:59.065501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.066382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4071-6cac-4047-af57-3056c143589b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:59.066647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:59.067163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:59.068727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:59.080572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 231/467] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:59.082139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fb64-5067-4fe8-9f1c-fa814c14a9ca None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.082434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fb64-5067-4fe8-9f1c-fa814c14a9ca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.082717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fb64-5067-4fe8-9f1c-fa814c14a9ca None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.083838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 237/468] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:54:59.087662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:59.090211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 232/469] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:59.092186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fb64-5067-4fe8-9f1c-fa814c14a9ca None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:59.196626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:59.223041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ca639-0a74-43fb-b3a5-1b12afb99bf9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:59.224038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fb64-5067-4fe8-9f1c-fa814c14a9ca None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:59.238789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:59.264223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534d4b3-c46a-4e08-ad46-45801d959e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:59.264860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d4b3-c46a-4e08-ad46-45801d959e60 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.265148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d4b3-c46a-4e08-ad46-45801d959e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.265430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d4b3-c46a-4e08-ad46-45801d959e60 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.266149 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534d4b3-c46a-4e08-ad46-45801d959e60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:59.267981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534d4b3-c46a-4e08-ad46-45801d959e60 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:59.272761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:59.274344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.274843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.275397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.277116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:59.279760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:59.292601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 238/470] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:59 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:54:59.293973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.294379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.294676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.309073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 233/471] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:59 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:54:59.328892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:59.330667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:59.447321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 239/472] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:54:59.471174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:59.587794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb56bf-dde5-4e5f-a2d3-9f17177c4025 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:59.628387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:59.629672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.630235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.630749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.644788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:59.646783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f4307b57-a1ea-4dc5-9431-b883702cddc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:54:59.668295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:54:59.669247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:54:59.670089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:54:59.670089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:54:59.670089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:54:59.670089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:54:59.672406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 234/473] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:54:59.678440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:59.766081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:59.823837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c0c7-1346-4cdf-b005-bc6bad8ccd2f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:54:59.838760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf82cbe-366a-41f0-acbe-3549b39fc51f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.839052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf82cbe-366a-41f0-acbe-3549b39fc51f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.839383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf82cbe-366a-41f0-acbe-3549b39fc51f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.841019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 235/474] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:54:59.846062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.846354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.846638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.865651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:54:59.867402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:54:59.887277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:54:59.887951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:54:59.888235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:54:59.888512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:54:59.889241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:54:59.889546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:54:59.890921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:54:59.903765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:54:59.913055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 240/475] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:54:59.920877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:54:59.999056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 236/476] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:55:00.027197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:00.094097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3849d9-6888-417b-b5f4-34205aed29c5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:00.140434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:00.156906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:00.157586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:00.157879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:00.158221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:00.158940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:00.160942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:00.186933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b359f6-addb-4d03-b438-f2221a182075 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:00.205109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 241/477] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:54:59 2022] POST /identity/v3/users => generated 249 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:00.229393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:00.230088 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:00.230433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:00.230717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:00.231511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:00.233048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:00.244710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.sql.core [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 14:55:00.244710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 14:55:00.244710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [parameters: {'id': '0506b93a94504d29b82d0a81ae7ff38c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 14:55:00.244710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() May 26 14:55:00.262733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return ref.to_dict() May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 14:55:00.263705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application yield resource May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.rollback() May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.force_reraise() May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise self.value May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application session.commit() May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 14:55:00.264604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._prepare_impl() May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.flush() May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._flush(objects) May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application compat.raise_( May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application flush_context.execute() May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rec.execute(self) May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 14:55:00.265493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 14:55:00.266392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 14:55:00.268249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [parameters: {'id': '0506b93a94504d29b82d0a81ae7ff38c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:00.269758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 14:55:00.270772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:00.271862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 237/478] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 14:55:00 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:00.271948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:00.423598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b7d2-cf4b-4f1c-adf3-09602acf800a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:00.477105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55406b2b-0baf-4cc7-9ffe-247da3948cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:00.478034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406b2b-0baf-4cc7-9ffe-247da3948cdd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:00.478323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406b2b-0baf-4cc7-9ffe-247da3948cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:00.478603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406b2b-0baf-4cc7-9ffe-247da3948cdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:00.494622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55406b2b-0baf-4cc7-9ffe-247da3948cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-55406b2b-0baf-4cc7-9ffe-247da3948cdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:00.503355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:00.505524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:00.508068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 242/479] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:00.513453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:00.538238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:00.639518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd905f0-e33f-4388-9244-a342922aff43 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:00.676420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:00.677019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:00.677305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:00.677583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:00.678331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:00.678640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:00.681061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deb529-bb8f-470c-bdaf-ccb5e2545a05 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:00.689776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 238/480] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:01.541230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee285-c2ad-4eb6-9c84-a8114d52fa28 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:01.541787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee285-c2ad-4eb6-9c84-a8114d52fa28 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:01.541787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee285-c2ad-4eb6-9c84-a8114d52fa28 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:01.543533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 243/481] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:01.549106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:01.549530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:01.549708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:01.576141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:01.577352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:01.667834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 239/482] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:01.716614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee285-c2ad-4eb6-9c84-a8114d52fa28 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:01.783271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:01.869388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee285-c2ad-4eb6-9c84-a8114d52fa28 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:01.918686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:01.919565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:01.919857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:01.920142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:01.937601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:01.946054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:01.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:01.947875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:01.951530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 244/483] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:01.957673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:01.965417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:02.105216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a03ad-07bb-41f5-b6b7-34f11849129e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:02.141103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:02.141693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.141982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.142263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.143019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:02.143409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:02.144811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cdd8d-cc52-46c6-bee4-372209d68d72 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:02.154266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 240/484] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:02.159997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:02.215112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865460f-bf56-4a02-9479-f048e78d4d9b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.215112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865460f-bf56-4a02-9479-f048e78d4d9b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.215112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865460f-bf56-4a02-9479-f048e78d4d9b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.216140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 241/485] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:02.221033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.221325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.221609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.249921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:02.253149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:02.320719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db6e41-22f0-470b-98ec-b16e7db1f5bb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:02.326134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:02.381051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:02.382253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.383252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.383753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.390745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:02.408061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 242/486] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:55:02.410604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:02.412398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:02.432138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:02.433035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:02.433864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:02.433864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:02.433864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:02.433864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:02.436178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 245/487] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:02.444480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:02.446113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:02.592839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d39c9-37dc-494b-87ed-6ae08ff8f721 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:02.618352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516f5e0-f81d-40c4-ba4c-a3325fb36005 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:02.636288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:02.637103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.637864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.638253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.639427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:02.639839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:02.641821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565705f-ea4a-4cb4-bffd-89bc2a972dd3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:02.657688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 243/488] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:02.659998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d911-7e88-4d71-9ab2-6837bd59cce6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.660334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d911-7e88-4d71-9ab2-6837bd59cce6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.660818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d911-7e88-4d71-9ab2-6837bd59cce6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.662736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e1d3-945d-41de-9f3d-e5155c840f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:02.662872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 244/489] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:02.664267 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3d911-7e88-4d71-9ab2-6837bd59cce6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:02.664615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e1d3-945d-41de-9f3d-e5155c840f73 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.665062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e1d3-945d-41de-9f3d-e5155c840f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.665482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e1d3-945d-41de-9f3d-e5155c840f73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.678911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58e1d3-945d-41de-9f3d-e5155c840f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0f58e1d3-945d-41de-9f3d-e5155c840f73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:02.690379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:02.691464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:02.692252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:02.695064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 246/490] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:02.696634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.697057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.697468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.719013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:02.720461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:02.736163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:02.742856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:02.808558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3d911-7e88-4d71-9ab2-6837bd59cce6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:02.809828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 247/491] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:02.811553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:02.847620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:02.848791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.849334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.849955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.859700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:02.861639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:02.879543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:02.880526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:02.881502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:02.884580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 245/492] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:02.885961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:02.938615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc4a9d-d3e8-4fdd-b870-b4f223fe9c1a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:02.982012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:02.983260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:02.983798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:02.984349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:02.985321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:02.985831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:02.987782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:02.997302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 248/493] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:02.998386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.010780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8aae5-72e2-4f0e-baf5-9a29332f9180 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.014907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.036655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.067831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.068797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.069205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.069492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.087341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:03.098180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:03.099169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:03.099944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 246/494] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:03.100593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.125458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4818c-d8a2-45a8-b117-9705d2c57125 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.162586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.163318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.163655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.164125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.164969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:03.165288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.166723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9988f51-663f-4d2c-9683-e8623119ede0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 249/495] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:55:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:03.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3062786-0037-4bfc-919a-830949adc907 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3062786-0037-4bfc-919a-830949adc907 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3062786-0037-4bfc-919a-830949adc907 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 250/496] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:03.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3062786-0037-4bfc-919a-830949adc907 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.220399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995218-33c2-4c48-85fa-4dc2340a40cb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.256616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.258050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.258454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.258822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.269695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.271203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:03.290508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:03.291425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:03.292262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:03.292262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:03.292262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:03.292262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:03.292262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 247/497] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:03.292530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.302546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.323652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.343740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3062786-0037-4bfc-919a-830949adc907 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.388752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.389685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.389976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.390260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.391014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:03.391360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.392745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaeb1b-c15d-44b6-adf8-d5546bbfe61c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.401644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 251/498] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:03.402862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.403185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.403473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.414307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5ba6a-457e-420d-82ad-8b3f5e242b97 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.420458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:03.421665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:03.452197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.453105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.453530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.453946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.492665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 252/499] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:03.495987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.532688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.534165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.563118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.565604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.608284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956eee-357f-49f4-9fe3-e6d8d76e673b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.637433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 248/500] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:03.638141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.645844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.646509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.646793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.647069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.647826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:03.648769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.650076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.661688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 253/501] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:03.662469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.740271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93bc7d-90ec-4d59-bfdc-c65ec436c157 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.765770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5349a45-1135-4457-af48-ce10689c7e11 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.767621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.776457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.777251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.777538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.777817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.784204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:03.788519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.789695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.802441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.803268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.803559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.803839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-18c4d3a9-762d-4baa-aff2-880acb2e5484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:03.808090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:03.808946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:03.809769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:03.809769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:03.809769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:03.809769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:03.809769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 249/502] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:03.810608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd650-a872-4550-a4df-4609e8a8abbe None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.810771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd650-a872-4550-a4df-4609e8a8abbe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.811042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd650-a872-4550-a4df-4609e8a8abbe None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.812474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 250/503] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:03.813006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd650-a872-4550-a4df-4609e8a8abbe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.817925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:03.826542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:03.827460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:03.828247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 254/504] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:03.829020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.921216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd650-a872-4550-a4df-4609e8a8abbe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.927895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84596ce-20b5-4f6e-86a1-b8d00c3efe3f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:03.959701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.961080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.961366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.961645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.963241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:03.964034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.964332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.964610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:03.971733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.972045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:03.973191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.973470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:03.988931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:03.989836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:03.990709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 255/505] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:03.991295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3ee2f3ef-0a78-4a41-92dd-c3ace5d48db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:03.991363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:03.992395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:03.993234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:03.993234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:03.993234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:03.993234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:03.993234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 251/506] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:03.993874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:03.994166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:03.994451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.015027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:04.016324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:04.044368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.045557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.103119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 252/507] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:04.103119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.108688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484d77f-599d-4c78-bc34-b045f20c4c76 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.144068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.144729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.145014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.145293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.146013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:04.146326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.147770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.163972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 256/508] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:04.163972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.203877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b809-dd40-48a2-b9b5-330be28b2d00 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.236905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.237575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.237865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.238147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.238900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:04.239246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.240636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.249381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 253/509] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:04.250168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.266949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.271267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857871-379b-4ccc-98d0-ee52a0c4bbdd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.276713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.307073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.307759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.308051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.308334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.309059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:04.309369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.310753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.322985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 257/510] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:04.323804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.353160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92534f-627d-4395-8dae-d13895a97d25 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.387374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.388068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.388357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.388641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.389491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:04.389802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.391302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.423530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5babb2b-f98f-48d2-b2bb-9c47c8fdaefd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.427886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 254/511] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:04.428708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.459983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.460855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.461152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.461435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.471841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.473364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:04.492808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:04.493647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:04.494490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:04.494490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:04.494490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:04.494490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:04.494490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 258/512] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:04.494910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.507227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.516766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.537756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7607fe0-4b6d-4d02-b7fa-c740d8567ad1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.573176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.573983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.574271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.574551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.581628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.583115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.595736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3075386-bad7-4e56-8eb1-fff3fc6d26b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:04.597872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:04.599020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 255/513] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:04.605570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.630502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.631366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.631673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.631973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.643582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.645135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:04.664072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:04.665345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:04.666171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:04.666171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:04.666171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:04.666171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:04.666171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 259/514] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:04.666171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.701894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654970-68c8-4135-aa55-2f35cd8a5162 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.732690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.737493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.738291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.738578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.738863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.745881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.747464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:04.764541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:04.765478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:04.766313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 256/515] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:04.767214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.770806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.779200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ebf13-c94b-43fe-82bb-42dba7cf32ad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.813093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.813963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.814251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.814537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.886000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.887503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.891134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f5b4-9cd6-4c0b-b118-d852e2d79842 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:04.923794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:04.924453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:04.963409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:04.963409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:04.963409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:04.963409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:04.963409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:04.963409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 257/516] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:04.964264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:04.964336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:04.987874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 260/517] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:04.988957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.008740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.049646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c7e1-e2a7-461e-b377-25950dbd7c53 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.083779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.084377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.084664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.084944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.086438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:05.086754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.088257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.093527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295a162-7dc1-436d-925f-5b31b883bbd9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.105632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 258/518] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:05.106441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.128408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.129065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.129350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.129629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.130342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:05.130647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.132031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.142988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 261/519] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:05.143780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.168406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.208037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30bfa-04f2-49df-bca2-4790a7c13f19 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.229189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.244305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.244590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.244867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.245658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:05.245967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.247122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceb141-4a9e-4d79-9f3b-51a68f968137 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.247451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.265587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 259/520] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:05.266770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.286025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.286736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.287033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.287370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.288125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.289898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.319181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 262/521] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:55:05 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:05.319181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.382991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291db449-4aa5-4be1-9388-1e6a81bbed61 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.403445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.426180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.427020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.427339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.427649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.429806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6056b9-1a0b-44b7-b238-a73d9b4113e9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.439595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.441196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:05.462631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:05.463814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:05.464876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:05.464876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:05.464876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:05.464876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:05.464876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 260/522] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:05.465376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.474214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.474895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.475215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.475500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.503326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.557627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.559156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.587300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c256f6-388d-4078-ab64-3996546b3a06 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.622878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.623800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.624085 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.624368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.632276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.634322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.639793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:05.650057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:05.651002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:05.652004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 261/523] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:05.653193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.669704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 263/524] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:05.671284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.772751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.783166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2ac4-ffa1-4407-83fb-9dace436c419 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.784622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b77e-6ccf-4145-83b4-ac3cd3066261 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.820908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.821584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.821873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.822213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.822943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:05.823287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:05.823402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.823941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:05.824228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:05.824503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:05.824743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.825334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=6351122de1824cdf901a0943f64a1b53) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:05.825646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:05.827102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:05.832830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 262/525] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/role_assignments?user.id=6351122de1824cdf901a0943f64a1b53&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:05.833729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.852239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 264/526] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:05.852834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:05.908048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:05.985613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b04f16-6e06-496c-813f-612954498ba1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:05.985960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59fe8-7a01-4969-9bec-15a222517c27 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.031058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.032277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.032541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.032827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.034612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:06.034872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.036457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.042504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.044896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.044896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.044896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.060387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.061865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.062794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 263/527] 10.222.0.45 () {56 vars in 1139 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:06.063896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.080851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:06.086422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:06.087455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:06.088297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:06.088297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:06.088297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:06.088297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:06.089729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 265/528] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:06.094797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.192852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628856-bab7-4b09-98da-53c1a79194bd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.210348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:06.225316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2a7b4-c425-40b8-aee1-c15bf877138c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.230306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.231160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.231456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.231741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.239206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.240677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:06.255621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:06.256462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:06.257474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 264/529] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:06.258164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.271771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.272432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.272720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.273554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.346176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:06.372852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.374090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b47d06-b95c-46af-83f3-9fda7de21f35 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.374942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.411702 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.412380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.412671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.412952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.414318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:06.414656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.416169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.434322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 265/530] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:06.435279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.485211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:06.497350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 266/531] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:06.502897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.562214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933dbe2-16d3-4184-af6e-70062a76dcba None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.599560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.600239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.600534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.600815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.602385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:06.602704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.604274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.606008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:06.621001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 266/532] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:06.622204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.630765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c6461-9481-4684-8e70-cf8cb483b4c9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.669799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.670769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.671184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.671564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.679628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.681208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:06.698906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:06.700007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:06.701059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:06.702402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 267/533] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:06.703287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.758902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:06.761307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c2d2-1046-4b75-9d4d-cce61f2db0ec None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.815190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e28a54-7c2c-4d80-8bcd-ad2a1d4997ce None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:06.818922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.821548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.822201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.822870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.838471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.840771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.852327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:06.853133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:06.853500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:06.853975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:06.854917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=fabeab62b09344859e4479dd227fc61a) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:06.855360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:06.856878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:06.866297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:06.867292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:06.868182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:06.868182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:06.868182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:06.868182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:06.868401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 268/534] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/role_assignments?user.id=fabeab62b09344859e4479dd227fc61a&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:06.868599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.875503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 267/535] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:06.878650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:06.949052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:07.029025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d240d9a-e489-4692-9f4f-b114a29207dc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.072509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.073196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.073489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.073775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.074688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:07.075016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:07.078230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:07.095130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 268/536] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:07.113078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067189-e310-466a-add1-9ae467d6ea6b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.118484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:07.159613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:07.194171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.195344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.195649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.195934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.196738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:07.197053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:07.198519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:07.219132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 269/537] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:07.227117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:07.296535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adf42b-7f8f-41e1-922c-888a0f11227b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.311053 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:07.357910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552b40-1ce2-41e1-b1ca-9de6ed6da573 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.374105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.374915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.375235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.375513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.391886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:07.393368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:07.420123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:07.420997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:07.421825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:07.423274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.423939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.424222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.424500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.425483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=20eba02f87c74008b2fcb4c89c81df34) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:07.425800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:07.427321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:07.430867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 269/538] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:07.436661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:07.449940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 270/539] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:07 2022] GET /identity/v3/role_assignments?user.id=20eba02f87c74008b2fcb4c89c81df34&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:07.562212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679bb5-7b89-4533-81dd-56b3b6d5e7a9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.606791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.607518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.607814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.608095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.608908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:07.609227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:07.610780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364f57b-eec4-4fa9-b921-f4f3bf4d6bef None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:07.625677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 270/540] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:07.631801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:07.687772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:07.708544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb0dd-1d51-420b-b6fb-657024e92247 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.708844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb0dd-1d51-420b-b6fb-657024e92247 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.709113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb0dd-1d51-420b-b6fb-657024e92247 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.711283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 271/541] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:07.716848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.717138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.717539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.735112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:07.736532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:07.760509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:07.814614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 272/542] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:55:07.814782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d674a-58c1-4755-b2a0-74f84ccb74c5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.839422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:07.892740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.893802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.894317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.894799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:07.895890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=4ae41b54b0504beb90cbd3da87c8f852) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:07.896410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:07.898598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:07.916654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 271/543] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:07 2022] GET /identity/v3/role_assignments?user.id=4ae41b54b0504beb90cbd3da87c8f852&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:07.949387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd4c84-002b-4fe0-be2a-ac7073482d9d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:07.988551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:07.989364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:07.989650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:07.989929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.000941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:08.009232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:08.010198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:08.011433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 273/544] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:08.016648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:08.185820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a6ef-5807-4bb6-a2ba-dd4bea16ecbd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:08.187504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:08.237029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:08.237707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.238000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.238282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.239035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:08.239381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:08.240758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0adbf0-fc96-428b-aa16-e00294dbe8a6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:08.255014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 272/545] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:08.261212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:08.282133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:08.372734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5711c-cf6a-42a0-829a-afa92cba02e5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:08.393641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa7bb-e233-4142-9afc-9a25e868ddcd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.393986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa7bb-e233-4142-9afc-9a25e868ddcd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.394211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa7bb-e233-4142-9afc-9a25e868ddcd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.396030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 273/546] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:08.409577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.409893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.410196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.420542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:08.421689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.422181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.422652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.435012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:08.436681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:08.456272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:08.456587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:08.457418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:08.458323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:08.458323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:08.458323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:08.458323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:08.458323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 274/547] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:08.461171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:08.471126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:08.537293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:08.574377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aadd0-261c-49ab-a2fd-5a7325cd7fb9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:08.602339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 274/548] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:08.609587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:08.610315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.610609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.610891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.611652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:08.611964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:08.613345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:08.626592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 275/549] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:08.632028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:08.648681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:08.802772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f12c-4b43-4e55-8ed2-0deffd115a40 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:08.804925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:08.812914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b879-0e67-4108-93e1-b136026eed7a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:08.845526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:08.847175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.847763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.848331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.851832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:08.852687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:08.852989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:08.853273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:08.861275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:08.862059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:08.862963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:08.871151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:08.872251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:08.873097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:08.876127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 276/550] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:08.884907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:08.886910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:08.891028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:08.892193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:08.892330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 275/551] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:08.892459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:08.892592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.001090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bda37a-21c4-404e-ac30-2d95a9404a18 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.059972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.060788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.061229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.061580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.062493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:09.062894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.063906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00141d-afe1-4411-9b2a-75d0b0ee7577 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.064596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.083996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 276/552] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:09.090501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.127440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:09.137342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.138067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.138356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.138654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.139493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:09.139828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.141313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.164391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 277/553] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:09.170899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.266687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452f65c-3cf3-45cc-a769-0aa6d2035d36 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.301719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:09.314800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.315994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.316470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.316923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.395368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.398732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.443498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:09.511206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 277/554] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:09.516284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.516986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07d308-ca07-45c0-8db9-83edf5d09c07 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.636990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36818-bcae-4c61-87bc-58b5770a99bd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.656504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.657165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:09.657333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.657710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.657928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.679435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.680710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.681236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.681753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.684392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.685953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.696781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.699027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:09.705493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:09.706494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:09.707886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:09.707886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:09.707886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:09.707886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:09.707886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 278/555] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 536 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:09.716020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:09.723177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:09.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:09.725565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:09.725565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:09.725565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:09.725565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:09.729341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 278/556] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:09.734477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.870120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c5ec-0b86-484b-84ee-7def4f9e79f8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.870949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af59b2-7fe5-45fe-bb8c-af0b66654b1b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:09.873003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:09.915373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.915983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.916269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.916545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.917274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:09.917584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.919214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbfdd3-5e95-4006-974a-a2a0c4508325 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.920348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:09.921396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.922313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.922812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.923786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:09.924345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:09.925991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:09.933227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 279/557] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:09.934522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810a89-8d3c-404b-9cf8-77eae68d5091 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.934810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810a89-8d3c-404b-9cf8-77eae68d5091 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.935104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810a89-8d3c-404b-9cf8-77eae68d5091 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.936724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 280/558] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:09.941725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 279/559] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:09.942739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:09.943041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:09.943351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:09.944808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:09.963609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:09.965014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:09.974764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.059346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 281/560] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:55:10.060326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.064205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894632-2fa0-463b-bbed-5778783b44ca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.105162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.106209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.106491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.106763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.115045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.116582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-42dc5f61-ac21-4a8e-8914-6f9bbb8ba542 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:10.130963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:10.131952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:10.132921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:10.133505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 280/561] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:55:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:10.134212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303404-52e3-41fd-9c9c-e4e116d3d9be None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.134449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303404-52e3-41fd-9c9c-e4e116d3d9be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.134722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303404-52e3-41fd-9c9c-e4e116d3d9be None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.139708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 281/562] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:10.139708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303404-52e3-41fd-9c9c-e4e116d3d9be None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.169006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.178370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d94f-ea71-42bd-bb30-809606a011bb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.213699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.214503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.214788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.215066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.221879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.223365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.236158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:10.238155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:10.239256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:10.240148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:10.244295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 282/563] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:10.244943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.255453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303404-52e3-41fd-9c9c-e4e116d3d9be None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.294381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1cdac-3a08-4b37-ae7d-882ce722019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.295321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1cdac-3a08-4b37-ae7d-882ce722019a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.295693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1cdac-3a08-4b37-ae7d-882ce722019a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.295909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1cdac-3a08-4b37-ae7d-882ce722019a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.307163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1cdac-3a08-4b37-ae7d-882ce722019a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-78c1cdac-3a08-4b37-ae7d-882ce722019a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:10.314995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:10.315956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:10.316795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 282/564] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:10.317498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.318554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.318554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.335806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:10.337125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:10.359582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6da9-22e9-46ed-b6cb-4027fec32917 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.394966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.395729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.396006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.396310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.397622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:10.398761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.400853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.412034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 283/565] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:10.412705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.431719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 283/566] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:10.431719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.441909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.512563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.540365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0879fb-c1d1-4bd1-8e06-aa39ac716182 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.540730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f74aec-dd29-41c8-8c0c-f19efd7575f2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.576361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.576728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.577049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.577326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.577435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.577616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.577718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.577929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.578347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:10.578651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.578757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:10.579014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.580067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.580502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.593367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 284/567] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:10.593367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.597577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 284/568] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:10.602404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.672994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.712110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec11754-53a6-4250-af3c-7c7cf2e116bd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.719933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cbb6-aa54-4c73-9a51-4b3eeab686b0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.749334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.750146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.750430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.750789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.756133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.756977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.757815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.758102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.760640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.764232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.765881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.770778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:10.780110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:10.781031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:10.781850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:10.783420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 285/569] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:10.784147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:10.785260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:10.786138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:10.786138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:10.786138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:10.786138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:10.787289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.790072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 285/570] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:10.790760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.895804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6bb07-5956-4a17-b611-bb2285b47709 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.898405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834aa05-ef96-4df0-bf25-d92a92fc3bdc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:10.918651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:10.931113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.931775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.932057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.932336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.933166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=853a5aefa1dc493b9d1b222d3de15156) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:10.933280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:10.933477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.934028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:10.934315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:10.934593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:10.934910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.940474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 286/571] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/role_assignments?user.id=853a5aefa1dc493b9d1b222d3de15156&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:10.941247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:10.952816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:10.955052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:10.974752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:10.976002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:10.977035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:10.977035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:10.977035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:10.977035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:10.977035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 286/572] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:10.977321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.040843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.087825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ec13-aaa1-4428-91b3-f4effa2cb1e8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.105898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fa78a-8a56-4ad2-8143-bac12cefb2e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.134229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.134457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.134634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.134883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.135664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:11.135969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.137333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24674be-4aa6-4aec-a6c4-a0349afd043e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.150403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 287/573] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:11.150620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.150620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.150620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.150841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a185746-78f5-462d-badb-822eba488ba9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.150911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.150996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a185746-78f5-462d-badb-822eba488ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.150996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a185746-78f5-462d-badb-822eba488ba9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.151151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:11.151151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.151308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 288/574] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:11.151390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.151461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a185746-78f5-462d-badb-822eba488ba9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.163968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 287/575] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:11.165134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.206473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.262659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a185746-78f5-462d-badb-822eba488ba9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.278536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33053c0a-0c72-4c1b-88d5-8594f86b839d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.290148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.299927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.300609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.300896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.301180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.301916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:11.302227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.303647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4de83-e566-4575-be76-979fe4c01ff2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.316526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 289/576] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:11.318199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.318770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.319291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.325494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.326612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.326918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.327251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.336724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:11.337779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:11.339040 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.340590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:11.360152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:11.361060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:11.361982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:11.361982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:11.361982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:11.361982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:11.361982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 288/577] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:11.362275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.419298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 290/578] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:11.419298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.472855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.477842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894b9fe-cb3c-40ca-917c-6974013d5fd6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.514845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.515668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.515951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.516232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.523737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.525281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.539027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4f637-954d-4044-940d-8f24b5412aff None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:11.542797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:11.543837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:11.544744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 289/579] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:11.545307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.566888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.581260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.582063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.582348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.582627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.590423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.591912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:11.607327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:11.608269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:11.609223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 291/580] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:11.610976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.667896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c92e4-bac2-44e6-99fa-763fb9fbe317 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.704019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.704700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.704966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.705240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.705954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:11.706257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.707646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.712602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.716396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14920-9835-4c51-a256-550e1001b75a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.724935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 290/581] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:11.724935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.753990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.754888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.755274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.755557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.767314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:11.776037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:11.777132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 292/582] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:11.778149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.817032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:11.841632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c7a9d-d66f-4ee3-9c34-47c934b38ead None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.879580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.880276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.880582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.881012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.881698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:11.882069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.884783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.896792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13153580-1cfa-46b5-a0f6-1f0f72019cd4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:11.902688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 291/583] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:11.903617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.935400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:11.936075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:11.936357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:11.936623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:11.937468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:11.937777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:11.939230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:11.957864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 293/584] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:11.958983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:11.979261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.028562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdeb0-92e5-4bb5-bca6-88fe5eba6f09 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.067526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.068331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.068607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.068884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.076903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9cba5-877b-47f0-b220-c701f5583889 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.078154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.079754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.081590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:12.095951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:12.096925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:12.097847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 292/585] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:12.098433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.122392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.123074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.123394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.123677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.124436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:12.124739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.126138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.140437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 294/586] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:12.141576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.213948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d042-a7f7-4150-9840-66ef602a274c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.232912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.249791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.250684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.250964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.251266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/6351122de1824cdf901a0943f64a1b53/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.255027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd791e-f6b7-49f0-98f9-fd03611541cd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.267511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=6351122de1824cdf901a0943f64a1b53, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.268951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.282806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 293/587] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:12 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/6351122de1824cdf901a0943f64a1b53/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:12.283581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.305757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.307218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.307662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.308089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.323027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.324792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:12.346360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:12.347510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:12.348583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:12.348583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:12.348583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:12.348583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:12.349471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 295/588] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:12.350459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.365638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.447689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74354b-89b0-47f7-a9cd-be2e686b3d35 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.469643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5f71-0f97-465e-86bc-26f1aafcb30f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.488882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.489716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.490079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.490457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.492020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:12.492813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.494265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.503743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.513413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.515470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.516303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.516917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.518007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 294/589] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:12.518951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.533665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.536399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:12.565384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:12.566580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:12.567761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:12.567761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:12.567761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:12.567761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:12.570588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 296/590] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:12.571985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.645535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8902-529c-4172-9930-187848f1a362 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.656224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.698863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.699963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.700421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.700859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.701829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:12.702426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.704196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.713553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4a8d-3d86-424c-9064-1e95cd3830e3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.718672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 295/591] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:12.719802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.752274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.753085 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.753686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.753823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.766896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.768495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:12.788079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:12.789586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:12.790454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:12.790454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:12.790454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:12.790454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:12.794798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 297/592] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:12.795965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.836260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.842645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39ddac-a09f-42f4-9f7b-3f618ce73508 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.884232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.885334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.886001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.886503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.887704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:12.888276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.890100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.905630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 296/593] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:12.907346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:12.916812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83afb0-39fe-4052-a61c-1b5c35bfc0fa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:12.941853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:12.960250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:12.960250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:12.960250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:12.960250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:12.969564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:12.971208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:12.987636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:12.988585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:12.989486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 298/594] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:12.989982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.029641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a56b5b-c7ab-4fd3-81ba-8cccbc7923f4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.068579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.069272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.069590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.069901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.070663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:13.070980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.072680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.086946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 297/595] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:13.088007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.108697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:13.115258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4738-09a3-4ce4-af54-b56e3222cf4f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.155165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.155971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.156254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.156531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.166000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.167612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:13.186183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:13.187478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 14:55:13.188527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:13.192130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 299/596] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:13.193122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:13.193711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.211196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1402f2-ba1c-462e-bc2c-1d70bbfec86f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.249101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.250048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.250487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.250925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.252007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:13.252567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.254140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.273757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 298/597] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:13.274911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.307469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f680241-4865-42ef-af45-d1f6cfca8873 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.342540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.343354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.343638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.343951 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.350625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.354338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-89924d52-2870-43f1-ae18-8fc4d065b034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:13.368664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:13.369594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:13.370467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 300/598] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:13.371314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9ffc-eacb-4307-a15c-0a02aae22e1e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.371314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9ffc-eacb-4307-a15c-0a02aae22e1e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.371579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9ffc-eacb-4307-a15c-0a02aae22e1e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.372831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 301/599] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:13.373493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9ffc-eacb-4307-a15c-0a02aae22e1e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.388496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbfe8c-7d1a-4490-a383-e0424ef2c613 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.396151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:13.429453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.430505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.430977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.431493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.432631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:13.433261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.434881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.454215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 299/600] 10.222.0.45 () {56 vars in 1139 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:13.455267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.462783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:13.488903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9ffc-eacb-4307-a15c-0a02aae22e1e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.524903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641f9ac-679a-43b1-a38a-a424433035cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.525819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f9ac-679a-43b1-a38a-a424433035cb None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.526102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f9ac-679a-43b1-a38a-a424433035cb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.526377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f9ac-679a-43b1-a38a-a424433035cb None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/fabeab62b09344859e4479dd227fc61a/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.543513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641f9ac-679a-43b1-a38a-a424433035cb None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=fabeab62b09344859e4479dd227fc61a, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.545337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641f9ac-679a-43b1-a38a-a424433035cb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.559660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 302/601] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:13 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/fabeab62b09344859e4479dd227fc61a/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:13.561158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.561537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.561892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.583368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2de4a-eddd-4526-9dec-44f8f3c49949 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.584938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:13.587379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:13.635125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.635841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.636136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.636419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.637300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:13.637608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.639235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.658207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 300/602] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:13.658922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.672628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:13.685385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 303/603] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:13.686747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.750656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:13.799595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46e30-2023-4414-9b88-9e12a602bda2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.831063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13500ca-11d2-4edc-a42e-a3cff92fdd86 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:13.848377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.849176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.849460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.849735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.866770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.869064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.873936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:13.874893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:13.875225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:13.875530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/20eba02f87c74008b2fcb4c89c81df34/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:13.891701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=20eba02f87c74008b2fcb4c89c81df34, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:13.891911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:13.892972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:13.894080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:13.894080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:13.894080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:13.894080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:13.894348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:13.895700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 301/604] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:13.897515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:13.911973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 304/605] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:13 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/20eba02f87c74008b2fcb4c89c81df34/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:13.913001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.028268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11f1a1-233e-4611-9ec9-787fbf52ab06 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.045024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:14.050636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:14.073680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.074497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.074786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.075064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.089003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:14.097857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:14.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:14.100199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 302/606] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:14.109789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.185142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b143ef4-03c8-46d2-b83c-779a9cb56527 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.234503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.235222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.235511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.235790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.236633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:14.236965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.238454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.252265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 305/607] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:14.260132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.266231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f331-6a0e-4313-90d6-448a451e55c5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.305536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.306216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.306504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.306782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.307567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:14.307876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.309264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.327713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 303/608] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:14.334312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.413586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:14.464441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec67a-b4da-4426-a97d-972ca84e8bda None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.479439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:14.500466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.500709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd538-2e03-4008-886d-506ae0191e38 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.501283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.501573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.502289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.511124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.512748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:14.529720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:14.530735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:14.531689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:14.535564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 306/609] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:14.537721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.653955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc3ff-f7d8-4663-ac44-d2334b26777c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.656365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.657193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.657476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.657753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.684060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.685445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.693086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.693765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.694094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.694384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.695983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:14.696806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.698295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.716077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 307/610] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:14.717316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:14.723350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:14.724256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:14.725226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:14.725226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:14.725226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:14.725226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:14.731541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 304/611] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:14.740067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.792922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:14.846576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e2c2-b423-461b-b1e3-e07f2cb9cfb8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.868332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:14.879832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fa7f7-4fe9-4ae3-86bb-6530d1111c92 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:14.897770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b5217-3087-4d80-9e6a-352900a89dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.899416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5217-3087-4d80-9e6a-352900a89dcb None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.899925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5217-3087-4d80-9e6a-352900a89dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.900814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5217-3087-4d80-9e6a-352900a89dcb None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/4ae41b54b0504beb90cbd3da87c8f852/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.919364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:14.920036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.920326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.920812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.921517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:14.921829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.923241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8706-8fe9-4845-bd9c-a79335eb5c23 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.923708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b5217-3087-4d80-9e6a-352900a89dcb None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=4ae41b54b0504beb90cbd3da87c8f852, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:14.926280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b5217-3087-4d80-9e6a-352900a89dcb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:14.937200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 305/612] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:14.942153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19e1d8-15f5-46eb-8ab5-93e288f5903c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.942449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19e1d8-15f5-46eb-8ab5-93e288f5903c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.942731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19e1d8-15f5-46eb-8ab5-93e288f5903c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.944229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 306/613] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:14.948464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19e1d8-15f5-46eb-8ab5-93e288f5903c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:14.953699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 308/614] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:14 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/4ae41b54b0504beb90cbd3da87c8f852/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:14.955373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:14.955883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:14.956370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:14.982644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:14.984402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:15.111403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 309/615] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:15.148357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:15.158019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:15.180397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19e1d8-15f5-46eb-8ab5-93e288f5903c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:15.235899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:15.236629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:15.236911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:15.237185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:15.246883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:15.248366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:15.264848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:15.265803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:15.266748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 307/616] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:15.271975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:15.290460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:15.295028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74e682-530e-4895-9321-a7c90d7847f4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:15.359843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:15.360978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:15.361455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:15.361921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:15.388034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:15.396306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:15.397346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:15.398813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:15.404457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 310/617] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:15.412020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:15.425871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14eb3f-0a89-4a51-8101-a70973d8cd9b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:15.471592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:15.473035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:15.473752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:15.474200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:15.475747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:15.476387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:15.478445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:15.515424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 308/618] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:15.524882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:15.564104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:15.605184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42083fb-390b-486b-a8a5-58279c8f6578 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:15.640385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:15.645141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:15.645826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:15.646109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:15.646385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:15.647156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:15.647464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:15.649750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:15.658999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 311/619] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:15.666870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:15.701174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c4fa-ed45-4fbc-9159-7829a5ba8cd2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:15.780946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:15.782045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:15.782291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:15.782663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:15.789233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b24916-1181-4f32-bcb3-0496a5433848 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:15.809128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:15.810870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:15.818914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:15.829411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:15.830449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:15.830891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:15.831359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:15.840940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:15.842057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:15.843176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:15.843176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:15.843176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:15.843176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:15.843176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 309/620] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:15.848012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:15.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:15.849849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:15.871097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:15.872218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:15.873234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:15.873234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:15.873234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:15.873234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:15.875336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 312/621] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:15.880503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.017097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8dcd2-bf99-4705-b91e-d8e14b4fa994 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.048161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.081412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.082092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.082378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.082655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.083414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:16.083723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.085618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.105624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 310/622] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:16.110488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.115063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad829bb-42dd-419d-8220-4cc4fcddf325 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.150788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.151500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.151795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.152078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.152813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:16.153126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.154608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.168097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 313/623] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:16.173290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.216264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.246495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98330fe-b23d-4282-b263-540415b98f14 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.277054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86755ba5-caed-4cec-9f19-b02bfad59b7e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.283329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.284134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.284684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.285393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.295444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.297301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.312727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.313679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.314074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.314426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a2240f71-0c2c-453c-a31f-8fd2ac3ef1de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:16.316252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:16.317125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:16.318025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:16.318488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 311/624] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:16.319858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed718-6624-49ba-9924-aa7c8a9920eb None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.320146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed718-6624-49ba-9924-aa7c8a9920eb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.320426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed718-6624-49ba-9924-aa7c8a9920eb None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.322177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 312/625] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:16.323216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.324970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.327640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed718-6624-49ba-9924-aa7c8a9920eb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1d4e7a2c-685d-4c88-a827-2539a69028a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:16.341177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:16.342195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:16.343194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 314/626] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:16.348103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.348404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.348688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.369316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:16.370496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:16.386359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.466565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed718-6624-49ba-9924-aa7c8a9920eb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.472777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 315/627] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:16.472777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.526692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.527511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.527816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.528052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.528157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.529012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:16.529386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.531318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.546356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 313/628] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:16.552217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.626058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8e9cb-4f7f-4b34-a124-15339a57ba38 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.663657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.668539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ad03-ad6b-4555-a506-73ff8121dc1b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.672263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.673267 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.673781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.674258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.675343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:16.675853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.677911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.701937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 316/629] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:16.703192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.710002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.711776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.712212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.712582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.723938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:16.732222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:16.733122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:16.733941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 314/630] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:16.734618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.811375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.824928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecad458-8d84-4618-84a3-d5707afca5a0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.847046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42d382-3579-4ada-a656-78dc421d3d10 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:16.862202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b68e6-945e-4774-a44d-f7b17ee8697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.863130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b68e6-945e-4774-a44d-f7b17ee8697a None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.863423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b68e6-945e-4774-a44d-f7b17ee8697a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.863708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b68e6-945e-4774-a44d-f7b17ee8697a None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/853a5aefa1dc493b9d1b222d3de15156/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.882554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b68e6-945e-4774-a44d-f7b17ee8697a None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=853a5aefa1dc493b9d1b222d3de15156, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.882554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b68e6-945e-4774-a44d-f7b17ee8697a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:16.891484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42c60-3bd0-4880-962d-7a02f66f2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:16.892445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42c60-3bd0-4880-962d-7a02f66f2b9f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.892887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42c60-3bd0-4880-962d-7a02f66f2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.893278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42c60-3bd0-4880-962d-7a02f66f2b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.899174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 317/631] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:16 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/853a5aefa1dc493b9d1b222d3de15156/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:16.900842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf0cc-0029-4479-b349-872fc5290303 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:16.902287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf0cc-0029-4479-b349-872fc5290303 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:16.902798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf0cc-0029-4479-b349-872fc5290303 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:16.904435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 318/632] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:16.905426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbf0cc-0029-4479-b349-872fc5290303 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:16.937126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:16.985130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42c60-3bd0-4880-962d-7a02f66f2b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:16.986600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42c60-3bd0-4880-962d-7a02f66f2b9f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.080923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbf0cc-0029-4479-b349-872fc5290303 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.124827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 315/633] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:17.126357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.126757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.127174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.131304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.133300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.133842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.134884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.135684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:17.135991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.137444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.143606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:17.147441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:17.148471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 319/634] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:17.148696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:17.149799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.226981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:17.245714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 316/635] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:17.246991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.273217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e765-5528-46a7-b090-95951439be85 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.320106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.321281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.321779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.322298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.335138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.337078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:17.356455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:17.357398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:17.358268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:17.358268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:17.358268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:17.358268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:17.359932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1ca2-6bff-46d8-81b2-a0b0b27df939 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.360793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 320/636] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:17.361958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.402481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.403701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.404213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.404688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.417663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.419547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.435655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:17.439739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:17.440623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:17.441518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:17.441518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:17.441518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:17.441518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:17.443879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 317/637] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:17.445009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.490816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7195-ed8b-49da-9e29-87d7af1f9b64 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.500804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:17.533707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.535061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.535384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.535671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.550945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:17.561628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:17.562711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:17.563575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 321/638] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:17.564264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.573614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82309-0037-4fd7-b75c-cc5516d113e9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.610164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.611157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.611628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.612088 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.612994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:17.613480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.615040 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.632025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 318/639] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:17.632191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.676815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205cee-1196-44cf-9ad9-f312182dfe11 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.690838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:17.716103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.716828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.717123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.717402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.718136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:17.718447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.719864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e7f4-4087-421a-a3e0-8339faf9481a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.736839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 322/640] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:17.736839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7be513-771a-4eda-9958-43ddfa2b4f75 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.736839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7be513-771a-4eda-9958-43ddfa2b4f75 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.736839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7be513-771a-4eda-9958-43ddfa2b4f75 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.736839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 323/641] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:17.736839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7be513-771a-4eda-9958-43ddfa2b4f75 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.750086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae6b34-014c-49c4-a306-85588fbbb8bd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.751848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:17.786800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.787507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.787798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.788101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.789756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:17.790070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.791478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.799876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 319/642] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:17.800666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.866375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7be513-771a-4eda-9958-43ddfa2b4f75 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.903790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.904588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.904877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.905155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.906387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb954c-32bc-491e-a4af-2c6499d99046 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:17.912442 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.914940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-535d9278-a6ba-48ca-8bac-eab75e25aa69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:17.929945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:17.930880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:17.932207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 324/643] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:17.932950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.933104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.933381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.949335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:17.950136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:17.950419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:17.950581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:17.950679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:17.951800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:17.958601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:17.960645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:17.974948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:17.975948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:17.977046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 320/644] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:17.977656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:17.985646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.004294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.043109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 325/645] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:18.043109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.094831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25977f-1622-450d-9be9-dbb28ff3c364 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.133009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.133009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.133326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.133445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.145735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.147234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.155996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d49d06-2ff4-49cb-9240-ce4b73d78688 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:18.166683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:18.167613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:18.168498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:18.168498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:18.168498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:18.168498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:18.168498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 321/646] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:18.169176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.196370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.197046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.197334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.197619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.198421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:18.198737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.200256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.215116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 326/647] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:18.215116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.240470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.262852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.289700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec93418-e64a-4acc-95c7-e3e6ae6d2126 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.324155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c9c3c-40ea-4903-a495-41ef525d753e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.332357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.333028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.333312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.333584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.334420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:18.334729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.336521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.358521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 322/648] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:18.358521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.365340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.366146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.366965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.367317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.378286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:18.387131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:18.388049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:18.388867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:18.390882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 327/649] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:18.391833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.465881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182183fa-7a31-4637-99d8-dab0fb0771a8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.481566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.502225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015829e5-8e25-4693-a24e-8dca814fb42c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.502373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.503014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.503336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.503619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.504350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:18.504684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.506049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.508402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.519768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 323/650] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:18.520575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.543563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b8778-05ad-4725-8794-f901373866bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.544231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b8778-05ad-4725-8794-f901373866bb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.544522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b8778-05ad-4725-8794-f901373866bb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.544808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b8778-05ad-4725-8794-f901373866bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.545653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b8778-05ad-4725-8794-f901373866bb None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=6351122de1824cdf901a0943f64a1b53) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:18.545975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b8778-05ad-4725-8794-f901373866bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.547559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b8778-05ad-4725-8794-f901373866bb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.553450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 328/651] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/role_assignments?user.id=6351122de1824cdf901a0943f64a1b53&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:18.554854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b8778-05ad-4725-8794-f901373866bb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.647080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9435-1ae1-48ec-b0bb-adcec7db6e21 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.688581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.689342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.689700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.690060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.703766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b8778-05ad-4725-8794-f901373866bb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.752584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.753311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.753600 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.753926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.754695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:18.755000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.757483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.773517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 329/652] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:18.774373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.776084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.791079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:18.791960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.793495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.904498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f054f21-af18-4ff7-9f0d-a823a9edb16f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:18.912643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 324/653] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:18.915014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:18.945556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:18.946398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:18.946943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:18.947256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:18.958846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:18.960980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:18.977805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:18.979071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:18.980278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:18.985546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 330/654] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:18.985546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.044364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.051919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163155a-34c4-4b63-87a8-1ec81427330d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.069163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.095429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.096758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.097360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.097899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.111128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.113051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.113646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb685e-cd27-43f9-9408-ae80ee538328 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:19.133253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:19.134202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:19.135078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:19.135078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:19.135078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:19.135078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:19.137462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 325/655] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:19.138739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.154125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.155212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.155323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.155520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.167855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.169287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:19.187352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:19.188271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:19.189156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:19.189156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:19.189156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:19.189156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:19.193084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 331/656] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:19.193945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.254113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fcb12-4f5e-417a-81e5-25f8fc9cd261 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.292037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.292842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.293012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.293255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.294087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:19.294394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.295873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.305712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a7ad-62c0-41bc-81ad-731f16991246 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.318358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 326/657] 10.222.0.45 () {56 vars in 1137 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:19.318358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.321013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.334239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.352007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.352676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.352963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.353234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.353973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:19.354289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.355707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea53c2-b532-428e-8a19-dbf2e2af027f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.367961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 332/658] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:19.369322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223c69-5b7a-4488-91ad-54b252ec2457 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.369613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223c69-5b7a-4488-91ad-54b252ec2457 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.369893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223c69-5b7a-4488-91ad-54b252ec2457 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.371309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 333/659] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:19.376157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223c69-5b7a-4488-91ad-54b252ec2457 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.427021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2988fd7-a75c-4236-8e98-0c4db6ed34df None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.465093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.465767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.466057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.466342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.467073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:19.467420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.469220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.481746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 327/660] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:19.486889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.496220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223c69-5b7a-4488-91ad-54b252ec2457 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.566879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.568011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.570129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.571062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.592272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.637854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12972a09-086c-4447-beca-f56b03778c38 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.638640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.669767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.671293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.687852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.688982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.689474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.689958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.699604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.702460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9aa90778-6986-4119-a5c2-f9c291bc90bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:19.719130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:19.720290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 14:55:19.721442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:19.723991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 328/661] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:19.724861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.725252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.725771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.744385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:19.745914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:19.798959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 334/662] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:19.800104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.839265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 329/663] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:19.839265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:19.907927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.913695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:19.936818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea0f3-e675-4aa9-9441-c223b7b49c45 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.957380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4788b96-0a4d-4b37-8e54-de86fcd434f6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:19.977988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.978793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.979108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.979397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.986908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.988540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:19.994878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:19.995654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:19.996019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:19.996362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:19.997266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:19.997639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:19.999123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:20.004342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:20.005364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:20.006463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:20.008345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 335/664] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:20.013618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.020527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 330/665] 10.222.0.45 () {56 vars in 1139 bytes} [Thu May 26 14:55:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:20.023520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.124484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c5db-ad94-4f05-a3e4-b667606d74c8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.135773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6491ee-13db-445b-82e5-5988deaabe44 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.150608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.161645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.162465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.162756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.163587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.173512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.174024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.174485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.174485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.174776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.176364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.178115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.185933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:20.193732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:20.194904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:20.195808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:20.197592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:20.198447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:20.200296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:20.200296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:20.200296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:20.200296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:20.200813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 331/666] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:20.200813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.203534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 336/667] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:20.205460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.315468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5f6c-902e-4f13-ab7b-5199259c0cac None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.320797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cdf81-ecea-491b-bd87-4553c03497e6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.356412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.357068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.357362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.357643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.359448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.360107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.360387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.360665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.361455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:20.361761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.363210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.376553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 332/668] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:20.377681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.411958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.433223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.445481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.447131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.492977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7eb1-a0bb-47dd-9757-ee40312d7331 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.531261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.532323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.532652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.532934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.533838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:20.534771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.536432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.547023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 333/669] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:20.547878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.564960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 337/670] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:20.564960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.649981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.657869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ed9c0-336f-4ba3-853e-04c32f1298f5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.665812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.675672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77e82f-677e-4f10-9482-7087b3e9b0fa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.695747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.696406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.696687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.696963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.698084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:20.698406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.699826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.713105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.717900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.718022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 334/671] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:20.718104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.718104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.718233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.718321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=fabeab62b09344859e4479dd227fc61a) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:20.718321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.718321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.727133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 338/672] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/role_assignments?user.id=fabeab62b09344859e4479dd227fc61a&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:20.727133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.862466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951f88c-1d39-43fa-bc0f-4f71668ea6c0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.870916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa58869-99d4-4440-a3b1-e013ad666952 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:20.902773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.903999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.904298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.904766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.920027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:20.920562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.920994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:20.921345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:20.921626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:20.922136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.935747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:20.937462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:20.945592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:20.946497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:20.947423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:20.947423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:20.947423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:20.947423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:20.948220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 339/673] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:20.949350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:20.959529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:20.962186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:20.964713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:20.964713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:20.964713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:20.964713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:20.965242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:20.965401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 335/674] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:20.965401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:20.977633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.078673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8b609-d317-46a5-89dc-d133fda46a45 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.089621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9484-d402-4c65-a87b-878bafe7cf9b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.115753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.116604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.116925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.117284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.124866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.125235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.126124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.126341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.126836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.127321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.128300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:21.128815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.130168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b36dd-b667-4f7e-8417-db15a3b7383a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:21.141829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:21.142747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:21.143679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 340/675] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:21.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.151130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 336/676] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:21.151130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140fd47-9645-4838-871a-819ab8cef8ad None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.151130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140fd47-9645-4838-871a-819ab8cef8ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.151448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140fd47-9645-4838-871a-819ab8cef8ad None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.152959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 337/677] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:21.153439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140fd47-9645-4838-871a-819ab8cef8ad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.218331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.227500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.255568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745d2b-443a-4166-860b-9e1c0038cb27 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.265223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140fd47-9645-4838-871a-819ab8cef8ad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.295034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.295733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.296033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.296301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.297028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:21.297338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.298721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.302493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.303319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.304136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.304437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.315608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 341/678] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:21.315798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.316210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.316297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ce38d148-e7a9-477f-b815-9ddcaad101ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:21.330963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:21.332063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:21.333007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 338/679] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:21.333502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.334156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.334156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.351761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:21.352946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:21.427204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24acf-68cf-4e6f-b223-6b0022e68bc4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.443107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 339/680] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:21.443107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.457337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.466371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.467034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.467349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.467627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.468767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:21.468767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.470152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.482362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 342/681] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:21.482983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.512409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.560406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e2c5-cdbd-4341-9aa4-7487d9e59ee7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.591475 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bde05-8c04-4fb7-8b31-6e51d8d75778 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.595915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.596720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.597006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.597285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.604991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.606445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:21.621849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:21.623119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:21.624282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:21.627477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 340/682] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:21.628300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.634226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.635129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.635570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.636025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.636969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:21.637561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.639023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.651900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 343/683] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:21.651900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.707189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.739663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58535e65-3e57-4d8c-8ca8-579f6f5f34b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.757993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:21.762854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32fa9e-21f1-4542-a03f-bc424e1c39e5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.779728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.780518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.780803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.781080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.792864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:21.798169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.798826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.799136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.799423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.800260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=20eba02f87c74008b2fcb4c89c81df34) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:21.800549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:21.801447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:21.808322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:21.808968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.808968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.809097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 341/684] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:21.809097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.809227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 344/685] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/role_assignments?user.id=20eba02f87c74008b2fcb4c89c81df34&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:21.809664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:21.934169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5fe3e-8193-4a52-84db-7755f180e07a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.973754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:21.974333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd1365-1187-4e21-952e-5057525900fd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:21.974450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:21.974641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:21.974922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:21.975902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:21.976215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:21.977716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:21.995326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:22.000344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 342/686] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:22.001280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.037714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.037714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.037714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.037714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.038294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=4ae41b54b0504beb90cbd3da87c8f852) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:22.038294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.039105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.048083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 345/687] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:21 2022] GET /identity/v3/role_assignments?user.id=4ae41b54b0504beb90cbd3da87c8f852&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:22.048932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.051827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:22.140939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332ea4-961e-4842-a05b-08251f18babf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:22.183681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.184424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.185056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.185056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.186556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:22.186874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.188412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.204323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 343/688] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:22.211321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.212823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d1f9-6601-450b-a46f-478df8dc9aba None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:22.267196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.267196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.267196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.267196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.347927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.348777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:22.350110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.356728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b453615-e4c7-4412-9bab-f877dfa8bb60 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:22.371478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:22.400424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.401281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.401575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.402174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.417335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.419506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:22.442811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:22.443996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:22.445165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:22.445165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:22.445165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:22.445165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:22.445165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 344/689] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:22.450937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.483245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 346/690] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:22.492131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.614243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:22.642173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f49c14-2069-471b-afb2-ccb354898177 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:22.654240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba0de-8d3f-460a-86c2-04080bc7fa67 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:22.690304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.691133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.691429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.691712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.716757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.718222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.720146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.720819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.721103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.721379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.722109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:22.722417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.723922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.755441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 345/691] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:22.756113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:22.757179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:22.758051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:22.758051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:22.758051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:22.758051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:22.758051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 347/692] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:22.760260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.768175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:22.777511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:22.889003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ca3fb-07b8-403a-9e7e-717736e5fa66 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:22.929943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:22.930754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:22.931041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:22.931342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:22.939741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:22.941297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:22.957585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:22.958591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:22.959555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 346/693] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:22.966179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.051365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.081147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62b61-b8bb-4728-ac9f-68eb3580766e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.092566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53afa27-420e-4197-973a-7ba2e3bf64d5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.153710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.154326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.154613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.154898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.155788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:23.156104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.157987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.173775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.181600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 347/694] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:23.186856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.193753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.195226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.195814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.196107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.196852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:23.197165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.199191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9be57-453a-4c55-b347-cc5f0ae94254 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.217142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 348/695] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:23.222814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a785a7-b1d7-4607-ad6a-3c0734e889ff None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.223130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a785a7-b1d7-4607-ad6a-3c0734e889ff None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.223420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a785a7-b1d7-4607-ad6a-3c0734e889ff None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.229070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 349/696] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:23.229902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a785a7-b1d7-4607-ad6a-3c0734e889ff None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.325711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782b7b-8ae4-4e77-90f8-4f009f653715 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.353590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a785a7-b1d7-4607-ad6a-3c0734e889ff None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.354520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.363534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.364195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.364484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.364766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.398396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.399766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.400294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.400775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.408847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.410983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fa0a31ef-0da0-4539-b727-1f5ef37e6083 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:23.426485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:23.427456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:23.428376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:23.435508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 350/697] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:23.437045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.437551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.437659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.438126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.439134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.457566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:23.459266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:23.510517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.548275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 351/698] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:23.549773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.559958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 348/699] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:23.567529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.609170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.678145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac581ed-cdd2-448d-a4de-4e0ab1461d9f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.703771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae39a-466f-4cfd-a274-bd051dfa6024 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.715537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.716210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.716509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.716793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.717595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:23.717911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.719384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.736690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 352/700] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:23.736690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.748200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.749297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.749810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.750290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.762577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.764577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.780970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:23.783885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:23.784996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:23.786466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:23.786466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:23.786466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:23.786466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:23.792726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 349/701] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:23.793830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.847747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e4fd-6062-41f6-8895-48a9114012d4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.877033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:23.884514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.885328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.885738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.885960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.897703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.899221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.905253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf1c49-c510-4b96-9aad-2fa501fc78ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:23.917942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:23.918902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:23.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:23.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:23.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:23.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:23.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 353/702] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:23.925077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:23.951261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:23.952296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:23.952784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:23.953262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:23.954308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=853a5aefa1dc493b9d1b222d3de15156) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:23.954825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:23.959510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:23.971652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 350/703] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/role_assignments?user.id=853a5aefa1dc493b9d1b222d3de15156&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:23.972933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.044489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:24.058051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1ff3d-e648-4b10-8b81-679aea9f5033 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.098891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.099681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.099978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.100265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.101427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:24.101746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.104057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.117232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 354/704] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:24.124238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.224404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7438-1222-4265-8507-24e78a25213c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.279916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.280739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.281260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.281747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.282594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:24.282997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.285715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.291303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9a409-0a6a-4583-86de-06fb6eecaff3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.302761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 351/705] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:24.315447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.319183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:24.446501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0b4af-faf3-461e-9d85-557f94718e40 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.467582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.468536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.468826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.469104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.478036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.479483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.490816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e64cf-cb03-46b9-a4e7-610ae593b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.492062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e64cf-cb03-46b9-a4e7-610ae593b7f8 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.492349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e64cf-cb03-46b9-a4e7-610ae593b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.492630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e64cf-cb03-46b9-a4e7-610ae593b7f8 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.493337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e64cf-cb03-46b9-a4e7-610ae593b7f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.494779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e64cf-cb03-46b9-a4e7-610ae593b7f8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f12bb2aa-feb8-4052-899f-397e5738fbe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:24.496227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:24.497067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:24.498386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 355/706] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:24.499049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe947b8-50be-40c2-b65a-27bc76e156c7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.499302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe947b8-50be-40c2-b65a-27bc76e156c7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.499586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe947b8-50be-40c2-b65a-27bc76e156c7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.501173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 356/707] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:24.506770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe947b8-50be-40c2-b65a-27bc76e156c7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.518026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 352/708] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:55:24 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:24.519389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.519684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.519963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.527826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:24.539140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:24.540387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:24.607043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:24.631116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 353/709] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:24.656585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe947b8-50be-40c2-b65a-27bc76e156c7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.656980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.752177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.752784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.753068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.753346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.754153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:24.754466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.755956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.778374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 357/710] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:24.787628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.804342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32642405-82dd-4054-b16c-c2342c2c56da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.847148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.847978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.848261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.848534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.849206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.851138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-db47d1f2-1135-464d-8245-02ffe53cb137 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:24.866134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:24.868267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:24.874715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 354/711] 10.222.0.45 () {56 vars in 1129 bytes} [Thu May 26 14:55:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:24.877460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b77e-b8e9-4ad8-b236-f0bc75149f4c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.877460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b77e-b8e9-4ad8-b236-f0bc75149f4c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.877460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b77e-b8e9-4ad8-b236-f0bc75149f4c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.877460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 355/712] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:24.878142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:24.878292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.878435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.878585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.900823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:24.902109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:24.908517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65525b07-c5e0-4ebf-84fb-40f61e2dea33 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:24.946887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:24.947596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:24.947886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:24.948171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:24.949026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=6351122de1824cdf901a0943f64a1b53) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:24.949343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:24.950796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:24.955474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:24.957137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 358/713] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:24 2022] GET /identity/v3/role_assignments?user.id=6351122de1824cdf901a0943f64a1b53&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:24.957949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:24.977994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 356/714] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 14:55:25.021790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:25.097345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3774d1a-594c-4d5a-8d81-c3acb1089dec None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:25.143116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:25.143116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:25.143116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:25.143116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:25.143585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:25.143585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:25.143585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:25.143975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:25.148925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 359/715] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 14:55:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:25.154475 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:25.271925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c366f86-c1ff-470a-a3f1-f8c974e76636 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:25.280847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d4739-9536-48fb-a8c9-069cb7b8a97c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:25.323406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:25.324217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:25.324501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:25.324780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] PATH_INFO: `/v3/services/network` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:25.325442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:25.326838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:25.339732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:25.340768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:25.341588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 357/716] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:25 2022] GET /identity/v3/services/network => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:25.348461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:25.371801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:25.372492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:25.372787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:25.373073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:25.373795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:25.374108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:25.375570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:25.390279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 360/717] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 14:55:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:25.404478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:25.487601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7b384-c6b2-44fd-83bd-8dab72fb6715 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:25.539446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:25.540528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:25.541020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:25.541624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:25.542806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:25.543452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:25.545611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3e9cb-b86a-4b2b-bb91-c33e2a37e832 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:25.561070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 358/718] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:25.566989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:25.678073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:25.729706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e43144-dda5-4b31-87c5-ab4265048fe4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:25.768932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:25.769632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:25.769921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:25.770199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:25.770919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] RBAC: Adding query filter params (type=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:25.771270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:25.773570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b287-aa61-4c1f-9b08-76075e761563 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:25.785376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 361/719] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:27.196539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527ce1-ffdb-4c90-bf27-1e53d6dd520f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.197056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527ce1-ffdb-4c90-bf27-1e53d6dd520f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.197131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527ce1-ffdb-4c90-bf27-1e53d6dd520f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.198766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 359/720] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:27.204258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2fb65-aef1-4855-b03a-e8b06f3713f0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.204666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2fb65-aef1-4855-b03a-e8b06f3713f0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.204890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2fb65-aef1-4855-b03a-e8b06f3713f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.228130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-89d2fb65-aef1-4855-b03a-e8b06f3713f0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:27.229346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-89d2fb65-aef1-4855-b03a-e8b06f3713f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:27.322303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 362/721] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:27.361594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68527ce1-ffdb-4c90-bf27-1e53d6dd520f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:27.378105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf918e9a-82ba-40f5-bd98-915b59d099f2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.378105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf918e9a-82ba-40f5-bd98-915b59d099f2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.378105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf918e9a-82ba-40f5-bd98-915b59d099f2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.378778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 363/722] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:27.384527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.385163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.385644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.405813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:27.407541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:27.491456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:27.498255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68527ce1-ffdb-4c90-bf27-1e53d6dd520f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:27.510241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:27.515558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 364/723] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:27.534477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:27.535320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.535615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.535900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.547151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:27.550351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:27.555597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:27.556721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:27.557608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:27.558341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 360/724] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:27.569745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:27.684923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a708f9f-4fad-4ee9-8354-88319010ee8c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:27.748581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:27.749276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.749564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.749848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.750607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:27.750920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:27.752343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:27.775145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 361/725] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:27.780632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:27.802282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d8e1-399e-4522-9e5d-dce46155943b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:27.863474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:27.899462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:27.900653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.901167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.901648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.936980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea55a-9afb-48d6-8db2-77fc0dacd910 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:27.951708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:27.960089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:27.961075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:27.961910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:27.972814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 365/726] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:27.974085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:27.974891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:27.975213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:27.976036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:27.979341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:27.988547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:27.990005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ad6f2d17-da1c-4794-9cdf-f6da123d10b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:28.016809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:28.017762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:28.018651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:28.018651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:28.018651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:28.018651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:28.023109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 362/727] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:28.023109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a547-9260-485c-8676-92c389b95fe3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.023109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a547-9260-485c-8676-92c389b95fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.023109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a547-9260-485c-8676-92c389b95fe3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.023438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 363/728] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:28.025148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a547-9260-485c-8676-92c389b95fe3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.037648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.098990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2c207-1213-420d-8a02-95f2e8ac78a0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.141535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.142673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.143284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.143770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.144734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:28.145246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.146831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0e843-19ba-4c50-9c1d-17f9e3b683fa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.153274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.157545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 366/729] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:28.159460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.159968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.160459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.175141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a547-9260-485c-8676-92c389b95fe3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.180151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:28.181628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:28.220890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.221550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.221772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.222057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.222792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:28.223127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.224774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.245202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 364/730] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:28.245202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.271217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 367/731] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:28.273488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.329785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.361086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b52268-9ea1-456a-897a-2bafd72180cb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.393457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54237e-44a9-4f47-98ab-c961b5b46b7e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.397327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.398161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.399590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.399590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.411643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.413903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.417035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-baa1b227-f2f9-4eae-aa69-36e569ad2a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:28.433920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:28.434905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 365/732] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d8d3-9d9d-4ccc-b459-634494a14b4e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d8d3-9d9d-4ccc-b459-634494a14b4e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d8d3-9d9d-4ccc-b459-634494a14b4e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.440770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 366/733] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:28.441274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d8d3-9d9d-4ccc-b459-634494a14b4e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.446226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.446417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.446660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.446988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.455029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.456677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:28.472235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:28.473185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 368/734] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:28.474134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.563560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d8d3-9d9d-4ccc-b459-634494a14b4e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.584328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.588407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0b33-c513-49d8-80d8-dcfa55f5cade None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.598595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2347-e2a5-4c47-ba34-37745704a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.599449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2347-e2a5-4c47-ba34-37745704a543 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.599734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2347-e2a5-4c47-ba34-37745704a543 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.600011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2347-e2a5-4c47-ba34-37745704a543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.610939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2347-e2a5-4c47-ba34-37745704a543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6f5d2347-e2a5-4c47-ba34-37745704a543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:28.619256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:28.620352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:28.621192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 367/735] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:28.621888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e03d4-7e18-4794-84d5-28e9e8d7e02e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.621888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e03d4-7e18-4794-84d5-28e9e8d7e02e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.622150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e03d4-7e18-4794-84d5-28e9e8d7e02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.630068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.630737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.631027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.631341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.632139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:28.632558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.633969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.638349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-636e03d4-7e18-4794-84d5-28e9e8d7e02e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:28.639568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-636e03d4-7e18-4794-84d5-28e9e8d7e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:28.645378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 369/736] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:28.646189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.690388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.707384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 368/737] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:28.708699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300bee-f346-439f-b9ae-f418c9f06258 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.708992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300bee-f346-439f-b9ae-f418c9f06258 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.709273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300bee-f346-439f-b9ae-f418c9f06258 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.712138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 369/738] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:28.712633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300bee-f346-439f-b9ae-f418c9f06258 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.755156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f7c4d-ab23-4b6e-95b3-71223f3ecc2c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.790192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.790866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.791181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.791463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.792305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:28.792619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.794058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.811878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 370/739] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:28.812695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.830205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.833010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300bee-f346-439f-b9ae-f418c9f06258 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.868468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.869133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.869419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.869694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.870437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:28.870741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.872156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b400b-f6b2-4f85-a016-5d1624c736f3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.880065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 370/740] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:28.881368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.882240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.882521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.898432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:28.899734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:28.916374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6ce3a-658b-4fed-bc16-f1f73204e827 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:28.948768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:28.951974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:28.952820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:28.953114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:28.953379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:28.960671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:28.962113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:28.972276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 371/741] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 14:55:28.973079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:28.976948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:28.977884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:28.978837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 371/742] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:28.979863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.076181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669df40-5ce0-4077-8760-60722d2e4c09 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.077843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.102681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940765f1-48e7-4da8-89ba-c40927a4740d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.110854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.111550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.111833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.112106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.112823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.114178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.129290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 372/743] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:55:28 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:29.130462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.145849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.146530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.146822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.147230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.179609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.241969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.243856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.250944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859318-5433-4aff-abcc-d2250729a392 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.289647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.290467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.290756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.291122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.304745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.306236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.323587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:29.327128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:29.328014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:29.328886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:29.328886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:29.328886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:29.328886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:29.328886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 373/744] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:29.329161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.362772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 372/745] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 14:55:29.363536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.442820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.455482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5cc3e-cb35-4b8b-b99a-982c4f2b9ed9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.468320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f386-e53e-4139-aaa4-3da1ddcb0145 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.493485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.494431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.494911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.495420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.496544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:29.497015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.498576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.505438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.506113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.506406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.506845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.507609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.508993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.518749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 374/746] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:29.519614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.529978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 373/747] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:55:29 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:29.531469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.585884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.651160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6debf-e6f7-4d9f-ab2e-f74473043727 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.691685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1058b1e-0e30-4a53-a08a-6757d51d1962 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.704911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.705654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.705945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.706231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.707327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:29.707646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.709340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.731268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 375/748] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:29.732455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.739440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.740549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.741063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.741492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.745750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.754987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.757030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:29.781448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:29.782410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:29.783366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:29.783366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:29.783366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:29.783366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:29.789662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 374/749] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:29.789662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:29.860186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60964ee6-7494-41c3-82c0-47ad72bf8bf6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.888461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:29.909952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.910617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.910911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.911274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.911956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4de8d0-96d8-44a4-84d5-f8b5049e28f4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:29.949851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:29.951011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:29.951535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:29.952046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:29.963259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:29.965065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:29.984166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:29.985218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:29.986189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:29.993732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 375/750] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:29.993732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.008388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.010360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.024910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.124518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e71ca1-cca0-484c-a3c6-61a4c8e616dc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.135852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 376/751] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:55:30.137016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.172545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.173223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.173523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.173809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.174544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:30.174854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.176586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.197870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 376/752] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:30.197870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.197870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.254367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0556a-2fa2-47b2-819b-8747985cf1cc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.266917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.298562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.299734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.300271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.300803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.301889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:30.302424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.304917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.325315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 377/753] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:30.326528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.332155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8eba1-bf51-4fec-ac38-cd917bc5fd60 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.373175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.373982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.374271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.374607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.386068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.387586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:30.411538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:30.412499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:30.413734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:30.413734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:30.413734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:30.413734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:30.414388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 377/754] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:30.417533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.456645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df0913-ba36-4f25-8201-ca22750a3a51 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.483543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.501515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.502421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.502780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.503178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.511121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.512668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:30.527024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:30.528838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 378/755] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:30.531073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.544225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a0c6-42b1-49c1-83e2-4aef41d2d544 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.564158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.581695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.582751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.583265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.583755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.594956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:30.616349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:30.617252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:30.618179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:30.618179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:30.618179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:30.618179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:30.620427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 378/756] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:30.621519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.662405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e94b2-78ba-45ed-8e3d-05ef2dd85088 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.712210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.713350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.713642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.713925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.714930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:30.715269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.716889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.735325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 379/757] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:30.736554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.738936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fc698-9192-4378-9969-ebcb010c1cf0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.743637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.793377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.793969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.794251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.794530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.795362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:30.795843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.797391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.815119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 379/758] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:30.815119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.847509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:30.865321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638a516-2427-4f97-b4ea-7e57add0f6cc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.904380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.905545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.906039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.906524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.907642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:30.908267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.910096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.924374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 380/759] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:30.925689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:30.928171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f681991-9e45-4bb1-9274-d19e1749a28e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:30.966863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:30.967695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:30.967983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:30.968259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:30.976751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:30.978201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:30.996241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:30.997197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:30.998108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 380/760] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:30.998632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:31.026840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:31.055124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b4e4b-76f2-4b23-9608-46674bcfa875 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.093192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.094305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.094801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.095400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.096513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=853a5aefa1dc493b9d1b222d3de15156) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:31.097065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.098821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.106267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 381/761] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/role_assignments?user.id=853a5aefa1dc493b9d1b222d3de15156&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:31.107370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:31.112033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b582-3c9d-452e-9e29-17362c986773 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.122377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:31.154039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.154861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.155147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.155423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.165360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.166960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:31.183172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:31.184146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:31.185040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 381/762] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:31.203177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:31.266444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da5cb6-3a0e-44ac-af3b-f3e35e569adb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.305184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:31.334964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ce78-8b3b-43ed-9f06-63def4baa83b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.339895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.340583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.340870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.341149 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.341955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:31.342266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.343749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.359571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 382/763] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:31.367542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:31.387396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.388086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.388665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.388951 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.389762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:31.390078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.392705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.408790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 382/764] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:31.415208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:31.455513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:31.492680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f07615-5f08-474f-8913-b22d57219938 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.539960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.540665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.540955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.541238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.542088 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=06c3bd6e24f248afa52f13a91c37f47f) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:31.542403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.544459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862c35e-da20-40fd-b5a2-01f2a402bd33 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.552334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 383/765] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:31 2022] GET /identity/v3/role_assignments?user.id=06c3bd6e24f248afa52f13a91c37f47f&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:31.554708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ebcb-8462-498e-ac1e-41d865c224e3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.554994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ebcb-8462-498e-ac1e-41d865c224e3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.555304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ebcb-8462-498e-ac1e-41d865c224e3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.561237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 384/766] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:31.564638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.565190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.565700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.578367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dd95b-0e19-4942-aa8b-a4b8be88e09d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.586926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:31.588597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:31.619765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.620734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.621106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.621283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/6351122de1824cdf901a0943f64a1b53/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.623626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=6351122de1824cdf901a0943f64a1b53, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.625094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.659673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 383/767] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:31 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/6351122de1824cdf901a0943f64a1b53/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:55:31.679267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 385/768] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:31.707269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:31.715030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:31.887217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c1ea4-4fd7-4d0a-af9a-a11382e595c1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:31.925328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:31.926548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:31.927045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:31.927568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:31.928490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:31.930077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:31.944674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:31.945640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:31.946464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:31.950026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 384/769] 10.222.0.45 () {56 vars in 1129 bytes} [Thu May 26 14:55:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:31.955303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.028222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:32.071605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138560e-ebd4-4eb6-8390-f6ecdd90ff32 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:32.109559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:32.110517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.110956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.111412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.112270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:32.112751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:32.114367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553ee2-53d3-4c61-a7fe-177f9501d77e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:32.124276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 386/770] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 14:55:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:32.125838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.165990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a095d-88cb-4f4f-9be2-772f52f033ac None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.166305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a095d-88cb-4f4f-9be2-772f52f033ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.166558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a095d-88cb-4f4f-9be2-772f52f033ac None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.169261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 387/771] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:55:32.176403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.176700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.176984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.194881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:32.196348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:32.217590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:32.260102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9257b48-4bf5-403a-8b29-d908ce4ffae3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:32.320724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 388/772] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:32.329828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:32.330514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.330803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.331103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.331839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:32.332152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:32.333539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:32.341895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 385/773] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 14:55:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:32.347756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.372519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.456998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:32.528256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3632-9f0c-4231-829a-ebea8e7d7728 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:32.571209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d65c54-0e1e-433e-81a2-d50669f7a320 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:32.593445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:32.594115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.594400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.594926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.595756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] RBAC: Adding query filter params (interface=public, service_id=45e5dfba6202440ba7bf9bed14b0858f, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:32.596070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:32.597456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:32.617809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 389/774] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:55:32 2022] GET /identity/v3/endpoints?service_id=45e5dfba6202440ba7bf9bed14b0858f&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:32.620958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:32.623335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.627953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:32.628765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.629048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.629327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] PATH_INFO: `/v3/services/network` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.629993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:32.631546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:32.644880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:32.645894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:32.646745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 386/775] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:32 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:32.654447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.797984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e420-5ac8-46d3-aecc-521ace486f1f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:32.861127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:32.861722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.862014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.862297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.863358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] RBAC: Adding query filter params (name=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:32.863682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:32.865228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:32.870376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 387/776] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:32.877404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:32.885023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f38f-79fb-450a-8a17-c67b2760d9e6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:32.924745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:32.950302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:32.950975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:32.951283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:32.951559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:32.952243 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:32.953611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:32.963937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 390/777] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:55:32 2022] GET /identity/v3/services => generated 772 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:32.998908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:33.062727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870ddf4-4fad-4a25-9978-e1f7f4a5de74 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:33.102011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:33.102695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:33.102980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:33.103299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:33.104027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] RBAC: Adding query filter params (type=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:33.104336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:33.105742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:33.111839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 388/778] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:33.118432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:33.258812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa47259-a285-4a97-a3fd-d7d312266005 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:33.300682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:33.301724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:33.302218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:33.302727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:33.303816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] RBAC: Adding query filter params (interface=public, service_id=259e219c68ea4fe9bc57b15e2f1e8c14, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:33.304358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:33.305928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e3667-4474-4993-ba81-06069028c3c3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:33.312368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 391/779] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:55:33 2022] GET /identity/v3/endpoints?service_id=259e219c68ea4fe9bc57b15e2f1e8c14&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:33.318123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:33.454010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376681-e3eb-4eba-8e30-cb8ae32cd370 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:33.486449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:33.502667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605795-4763-4d4d-825c-9c8ca0dfca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:33.503371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605795-4763-4d4d-825c-9c8ca0dfca38 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:33.503659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605795-4763-4d4d-825c-9c8ca0dfca38 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:33.503977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605795-4763-4d4d-825c-9c8ca0dfca38 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:33.504672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605795-4763-4d4d-825c-9c8ca0dfca38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:33.506033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605795-4763-4d4d-825c-9c8ca0dfca38 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:33.513000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 389/780] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:55:33 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:33.903291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216aa49-0320-4c47-9767-e922c645d115 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:33.903811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216aa49-0320-4c47-9767-e922c645d115 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:33.903888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216aa49-0320-4c47-9767-e922c645d115 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:33.905671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 392/781] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:33.911872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92938-3cb0-44f9-a951-3d64b6f4d407 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:33.912173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92938-3cb0-44f9-a951-3d64b6f4d407 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:33.912464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92938-3cb0-44f9-a951-3d64b6f4d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:33.933485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-46c92938-3cb0-44f9-a951-3d64b6f4d407 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:33.934697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-46c92938-3cb0-44f9-a951-3d64b6f4d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:34.041208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 390/782] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:34.067945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216aa49-0320-4c47-9767-e922c645d115 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.145959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:34.171070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3bcb-1ef1-435a-80f4-0a3ec97781f3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.171746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3bcb-1ef1-435a-80f4-0a3ec97781f3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.172247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3bcb-1ef1-435a-80f4-0a3ec97781f3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.174115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 391/783] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:34.180389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.180952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.181466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.221515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216aa49-0320-4c47-9767-e922c645d115 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:34.223570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:34.224777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:34.285079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:34.285885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.286173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.286449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.309491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:34.321764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:34.322783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:34.323657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 393/784] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:34.330619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.345075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 392/785] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:34.368692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.427536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:34.500681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb02a-dc4e-433b-a95d-2c374c6bdbe5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:34.548963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b9a5-3478-4447-9620-cececcebbdf7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:34.567116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:34.570038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4845c05-7e02-4241-830b-e106ac5f7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:34.570839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4845c05-7e02-4241-830b-e106ac5f7617 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.571292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4845c05-7e02-4241-830b-e106ac5f7617 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.573023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4845c05-7e02-4241-830b-e106ac5f7617 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.587117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4845c05-7e02-4241-830b-e106ac5f7617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e4845c05-7e02-4241-830b-e106ac5f7617 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:34.594468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:34.595480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:34.596345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 393/786] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:34.597179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:34.599328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1028a8-490f-4701-997a-cd56c2833133 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.599328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1028a8-490f-4701-997a-cd56c2833133 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.599328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1028a8-490f-4701-997a-cd56c2833133 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.599619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.599619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.599619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.599857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 394/787] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:34.599941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:34.599941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:34.604855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1028a8-490f-4701-997a-cd56c2833133 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.604999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d8c56-8ad0-4b69-8159-e8bc78f2f35d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:34.626254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 394/788] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:34.628285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.628759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.629190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.651812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:34.653729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:34.721944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1028a8-490f-4701-997a-cd56c2833133 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:34.733070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:34.767111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 395/789] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:34.767111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.783123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:34.783856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.784400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.784742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.786361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:34.786693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:34.789328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:34.800882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 395/790] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:34.802430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.891968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb897a6-1e3b-4a3f-9e76-0b6583d23589 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:34.893522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:34.922825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677d955-7027-43b3-aa60-bb81834c574b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:34.929471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:34.930277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.930566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.930849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.941560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:34.943020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:34.962343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:34.963304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:34.964315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:34.964315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:34.964315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:34.964315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:34.964315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 396/791] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:34.965016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:34.967067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:34.968296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:34.968843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:34.969347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:34.981569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:34.990337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:34.991845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:34.992700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:34.995256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 396/792] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:34.996943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.047255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.133009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57e10-565a-4287-b79c-37ad533a24fd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.170894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.172028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.172608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.173089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.174076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:35.174587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.176270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.190536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 397/793] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:35.191741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.206157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d4f8-714c-4058-ac75-092fe4781b34 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.244679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.245450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.245736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.246017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.257282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.259310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:35.283218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:35.284455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:35.285804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:35.285804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:35.285804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:35.285804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:35.285804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 397/794] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:35.285804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.295788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.319393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.337316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00a2fb-0bac-4948-8fbb-000921b1500c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.385742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.387324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.387809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.388524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.389739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:35.390645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.392790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.400379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5790-1b43-46cc-906e-ca9db7a9e195 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.410882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 398/795] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:35.412035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.440315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.441258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.441609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.441958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.450372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.452058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:35.468014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:35.468968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:35.470100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 398/796] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:35.471580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.552896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6862f8-1b53-4ad8-a6da-f510a2dcee31 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.555871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.600703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.601583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.601970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.602348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.602630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2c26-d72c-4116-a193-09268fbf20f2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.603371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:35.603781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.605258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.618858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 399/797] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:35.619879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.637249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.652824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.654123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.654962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.655450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.670345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.672789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:35.695486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:35.696464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:35.697347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:35.697347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:35.697347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:35.697347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:35.697347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 399/798] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:35.698056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.741567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4f2b-7148-4b55-9d00-1e3c53f8fa3f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.779035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.779737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.780022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.780295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.781139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:35.781447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.782886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026bd3-c19a-4746-9cd5-0a9c03202c0e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.801214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 400/799] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:35.802401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9bd34-c7be-43f3-9349-0c0eb8b43076 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.802689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9bd34-c7be-43f3-9349-0c0eb8b43076 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.803018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9bd34-c7be-43f3-9349-0c0eb8b43076 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.805136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 401/800] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:35.808186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9bd34-c7be-43f3-9349-0c0eb8b43076 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.818328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a02f8-3072-4623-8a61-441f00763193 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.837251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.856383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.857200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.857483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.857759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.865490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.868072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:35.890270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:35.891427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:35.892392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:35.893675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:35.896272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 400/801] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:35.897303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:35.929284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9bd34-c7be-43f3-9349-0c0eb8b43076 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:35.966401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:35.967076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.967448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.967732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:35.968486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:35.968794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:35.970171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e6654-2031-48d5-816d-6e1e625f4f06 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:35.982617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 402/802] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:35.983785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:35.984084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:35.984366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.001562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:36.002744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:36.008434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644d97-4f6d-4482-a521-a12922263e9d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.050256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.051079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.051394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.051670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.064522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.066123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.083626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 403/803] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:36.084790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:36.085335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:36.086392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:36.087509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:36.087509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:36.087509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:36.087509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:36.093366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 401/804] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:36.094331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.127823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.155992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.198214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dcb14-81bc-49e7-b7da-d7cd1d01638b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.206253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d3692-a9b4-4cd6-afe0-4db51d59d587 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.235462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.236143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.236430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.236713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.237561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:36.237973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.239342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.243956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.244750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.245035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.245309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.252814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.254260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.261633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 404/805] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:36.261633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:36.274383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:36.275545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 402/806] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:36.276648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.362453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c700-df3d-46f8-a368-3f9d8716f71a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.366080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.376152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2122e-c298-4e62-a894-892bfaad7493 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.379747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.397493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.398392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.398678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.398955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.399735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:36.400038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.401405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff01023-e19f-4392-8a56-ee188bca953c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.409947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.410861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.411177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.411456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.412108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.413911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 405/807] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:36.414021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.415128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367bdb-b0fb-4044-b1b7-8abe14361af1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.415421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367bdb-b0fb-4044-b1b7-8abe14361af1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.415697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc367bdb-b0fb-4044-b1b7-8abe14361af1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.416952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 406/808] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:36.417638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc367bdb-b0fb-4044-b1b7-8abe14361af1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:36.431786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:36.432899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:36.434356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 403/809] 10.222.0.45 () {56 vars in 1129 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:36.435459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.524574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc367bdb-b0fb-4044-b1b7-8abe14361af1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.534617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a816e-ed2a-40fe-95e2-0f28fdebe545 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.558306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.559117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.559412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.559694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.568360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.569228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.569515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.569797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.570651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:36.570949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.571051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.572416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.572521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.590666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 404/810] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f391db30-6f0c-4f77-a895-81f1a15afa41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:36.591194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:36.592057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:36.592942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:36.592942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:36.592942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:36.592942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:36.593158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.593228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 407/811] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:36.593766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.594125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.594340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.610505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.611648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:36.612901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:36.637466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.682155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 408/812] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:36.682978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.698180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611d09-002f-4b08-97ea-defa7c288a2e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.732860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.733655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.733940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.734215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.741569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.743078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:36.756900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:36.757959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 405/813] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:36.759046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.802019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00fa7-818e-48d1-831b-a3ed4285bfe1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.830807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.840327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.840999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.841290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.841574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.842291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:36.842601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.844063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.848503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 409/814] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:36.849276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:36.865614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824246-e5fc-49f9-9331-6b61bae8d616 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.876190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:36.900497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.901158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.901446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.901730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.951918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab2ca-0bf6-496d-86fe-2891ee293b18 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:36.970198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.971669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:36.985938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:36.986600 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:36.986877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:36.987185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:36.987900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:36.988211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:36.989557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.000982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 410/815] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:37.001758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.045435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.078420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 406/816] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:55:37.079284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.092362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.108288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a78f-5eca-4ddb-baac-e19fbfcab563 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.142196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.142923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.143263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.143535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] PATH_INFO: `/v3/services/network` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.144186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.145562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:37.159226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:37.160394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:37.161759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 411/817] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:37.162618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.179364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b623e-5650-4097-baa2-0bea0940deef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.213169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.213823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.214108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.214390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.215211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:37.215521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.216934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.228624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 407/818] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:37.229647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.261838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.262207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a151d6-a5f4-4982-b066-5fe790a85e91 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.297244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.297924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.298202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.298472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.299200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:37.299505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.300904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.306774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 412/819] 10.222.0.45 () {56 vars in 1124 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:37.307573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.325498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.351730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7e2e9-2ee5-4491-b54c-84addac3e990 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.385674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.386470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.386758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.387039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.393898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.395296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:37.410556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:37.411515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:37.412425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:37.413496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc0efb-2cc4-4ea8-b52a-50554de38328 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.413585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 408/820] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:37.413585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.446929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.447751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.448039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.448317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.458761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.460380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:37.478202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:37.479308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:37.480249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:37.480249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:37.480249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:37.480249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:37.480249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 413/821] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:37.480521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.509940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.519000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2218c6-6c93-42b6-bf01-1a9a07af72b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.542602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.554019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.554681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.554968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.555274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.555979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:37.556283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.557641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.562093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 409/822] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:37.562993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.586057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6e40-7b6f-48d5-90e1-3a67e0ea4ab6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.619178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.620097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.620413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.620695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/853a5aefa1dc493b9d1b222d3de15156/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.622662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=853a5aefa1dc493b9d1b222d3de15156, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.624149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.638371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 414/823] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:37 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/853a5aefa1dc493b9d1b222d3de15156/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:37.639408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.676281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266610c-d827-493f-80ed-65dcad2634ad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.722555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.723272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.723558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.723835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.724594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.726222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.752536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 410/824] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:55:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:37.753645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.780115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.793725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fabc57-5cb3-4377-a5ea-933cba415b33 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.830729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:37.854540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.855344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.855957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.855957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.856959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:37.857271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.858838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.874485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 415/825] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:37.875310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:37.910921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39217-f6a2-4a71-8388-49b209dd867b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:37.965888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:37.966633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:37.967048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:37.967446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:37.968552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:37.969068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:37.971041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:37.988114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 411/826] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:37.989258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:38.009024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f40078-9535-433d-9690-b81d18ad7d7e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:38.053811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:38.054649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:38.055040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:38.055456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:38.056270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] RBAC: Adding query filter params (type=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:38.056719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:38.058233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:38.065257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 416/827] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:38.066266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:38.081347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:38.115926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd327f-694c-4fd7-8e18-4c173d96c3b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:38.132837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:38.166435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:38.168075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:38.168463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:38.168842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/06c3bd6e24f248afa52f13a91c37f47f/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:38.190123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=06c3bd6e24f248afa52f13a91c37f47f, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:38.192390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:38.195465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd16b-97c2-42d1-8414-6193b45e6c80 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:38.223201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 412/828] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:37 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/06c3bd6e24f248afa52f13a91c37f47f/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:38.223201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:38.274459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:38.276236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:38.276557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:38.276839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:38.293090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:38.294598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:38.325624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:38.326782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:38.328034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 417/829] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:38.333623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:38.416923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd793c3-7b97-4144-867a-c46eab4c7c4c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:38.465110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:38.474712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a513-6461-4a34-972f-a920f3f774b1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:38.491576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:38.492499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:38.492790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:38.493066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:38.494210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:38.495933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:38.512584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:38.532229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:38.533280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:38.533744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:38.534507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:38.535964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:38.536799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:38.540443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4372-b58e-457c-80ed-6323fc1fa204 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:38.542228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 413/830] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:55:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:38.557511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 418/831] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:38.563330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:38.745585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05214c-f886-4847-8163-1c78b4459b04 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:38.797547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:38.798997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:38.799469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:38.799817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:38.800783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=6351122de1824cdf901a0943f64a1b53) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:38.801157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:38.802787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e6a6-2693-4088-9cf0-8a4ed086a4b6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:38.811984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 414/832] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:38 2022] GET /identity/v3/role_assignments?user.id=6351122de1824cdf901a0943f64a1b53&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:40.128106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813a13-82d9-4e12-834c-60ceb3b782cc None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.128689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813a13-82d9-4e12-834c-60ceb3b782cc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.128689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51813a13-82d9-4e12-834c-60ceb3b782cc None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.130269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 419/833] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:40.136689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25bd9-8af3-4182-a55c-c7e5772f836b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.137144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25bd9-8af3-4182-a55c-c7e5772f836b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.137297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25bd9-8af3-4182-a55c-c7e5772f836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.154829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9ce25bd9-8af3-4182-a55c-c7e5772f836b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:40.156043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9ce25bd9-8af3-4182-a55c-c7e5772f836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:40.187495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:40.228323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 415/834] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:40.236219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c74a-f0ff-4497-b698-77f0a9dce0c6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.236512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c74a-f0ff-4497-b698-77f0a9dce0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.236793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c74a-f0ff-4497-b698-77f0a9dce0c6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.238283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 420/835] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:40.243813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527c22-078f-4972-a145-114518405838 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.244343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527c22-078f-4972-a145-114518405838 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.244814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527c22-078f-4972-a145-114518405838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.257128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c74a-f0ff-4497-b698-77f0a9dce0c6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.262953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8e527c22-078f-4972-a145-114518405838 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:40.264391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e527c22-078f-4972-a145-114518405838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:40.347266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 416/836] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:40.364554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527c22-078f-4972-a145-114518405838 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.390752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c74a-f0ff-4497-b698-77f0a9dce0c6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:40.445124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:40.445947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.446392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.446835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.462772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:40.473808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:40.474842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:55:40.476090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:40.479160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 421/837] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:40.481996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.485137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:40.489761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527c22-078f-4972-a145-114518405838 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:40.528457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:40.530506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:40.531943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.532239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.532524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.533191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:40.535180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:40.548030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:40.549161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:40.550062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:40.554517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 417/838] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:40.556196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.639940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e549fa-4290-40ec-9190-1404c59ee837 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:40.681977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962453-dad1-40d1-b0d3-2ec1379b5241 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:40.688054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:40.688953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.689389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.690328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.691288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:40.691759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:40.694276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:40.710852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 422/839] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:40.712588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.724762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:40.726554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.726554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.726846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.727597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:40.727909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:40.729610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:40.739053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 418/840] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:40.740426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.773685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:40.818166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:40.834010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b43d2-6bb0-431c-969a-680263fb9d69 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:40.856912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb29b-6469-4743-894a-128c019db669 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:40.871058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:40.871893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.872182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.872461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.884889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:40.886348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:40.892363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:40.892975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.893270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.893546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.894261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:40.894578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:40.896038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c306d-adc7-4e7c-90dd-d41abd3b91b5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:40.902413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 419/841] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:40.903685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55e66-b2a2-467f-9c70-c0767429173a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.903978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55e66-b2a2-467f-9c70-c0767429173a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.904258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55e66-b2a2-467f-9c70-c0767429173a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:40.906816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:40.907841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:40.908720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:40.908720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:40.908720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:40.908720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:40.910054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 420/842] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:40.916365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:40.916365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:40.916365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:40.916732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 423/843] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:40.918320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:40.935979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:40.937271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:41.025651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 421/844] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:41.047117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.063250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530efdc9-0a19-4ea9-a09b-2f7352af684a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.091482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.105833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.106875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.107392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.107881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.108811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:41.109396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.111075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.119982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.126877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 424/845] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:41.134363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.164830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32b27f-48ee-4dcc-b5cb-0a99295fed15 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.200801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f5960-97b3-4ad9-a010-e6a11796c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.201607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f5960-97b3-4ad9-a010-e6a11796c198 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.201897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f5960-97b3-4ad9-a010-e6a11796c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.202173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f5960-97b3-4ad9-a010-e6a11796c198 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.213320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f5960-97b3-4ad9-a010-e6a11796c198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-dd6f5960-97b3-4ad9-a010-e6a11796c198 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:41.221142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:41.222095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:41.222917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 422/846] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:41.224217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d2b2-1fee-4358-aea8-1437a7622d35 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.224217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d2b2-1fee-4358-aea8-1437a7622d35 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.224538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d2b2-1fee-4358-aea8-1437a7622d35 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.226438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 423/847] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:41.228583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d2b2-1fee-4358-aea8-1437a7622d35 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.256153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b87472-b802-4fab-8cc9-9d47b3921404 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.294401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.295236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.295549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.295830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.303836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.305300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-79e03bef-444c-4617-a254-a89edc90f800 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:41.320240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:41.321288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:41.322257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 425/848] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:41.323566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85028-524e-4281-afba-958908735240 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.323566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85028-524e-4281-afba-958908735240 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.323747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85028-524e-4281-afba-958908735240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.324210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.347707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d2b2-1fee-4358-aea8-1437a7622d35 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.349025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-eae85028-524e-4281-afba-958908735240 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:41.351345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eae85028-524e-4281-afba-958908735240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:41.385439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.386114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.386420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.386701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.387478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:41.387790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.389162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.403298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 424/849] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:41.403298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.416204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.437934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 426/850] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:41.437934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae85028-524e-4281-afba-958908735240 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.510187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cea63-1e61-480c-b057-b3db3bf792f5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.547174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.547971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.548258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.548541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.549373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:41.549690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.551129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.559280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae85028-524e-4281-afba-958908735240 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.566637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.575927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 425/851] 10.222.0.45 () {56 vars in 1135 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:41.576780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.599215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.600287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.600611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.600856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.611739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.613021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:41.632129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:41.633234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:41.634212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:41.634212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:41.634212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:41.634212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:41.634212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 427/852] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:41.634212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.681438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.687678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719e8ce-3f88-4ffa-b071-86393204be47 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.726332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.727184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.727468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.727744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.728401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.729753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:41.742273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:41.743267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:41.744123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 426/853] 10.222.0.45 () {56 vars in 1132 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:41.744951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.750989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444ac0c-3400-4a66-8d40-b13c72f0883f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.790050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.790713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.791000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.791316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.813512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.856936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cf3d6-6359-444a-b4d6-1bbad335cf35 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:41.864933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.866969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.892052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:41.892714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:41.893000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:41.893279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:41.894113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:41.894428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:41.895887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:41.908768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 427/854] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:41.909641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:41.914782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:41.979858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 428/855] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:55:41.980711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.021510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686abbd0-115a-4144-af5d-821a3e46229f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.049000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.061503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.062190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.062474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.062753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.063529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:42.063840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.065249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.071340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 428/856] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:42.073354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.096663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f605e2-b5a8-4768-bdc4-1f8fc88ab47f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.138229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.139927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.140189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.140410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.147988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.149447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.152201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:42.167544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:42.168545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:42.169473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:42.173595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 429/857] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:55:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:42.174083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.188106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c434b0-03ca-4503-90fb-8367182a1e8f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.224214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.225751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.226042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.226318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.237791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.239331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:42.262756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:42.263928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:42.264880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:42.264880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:42.264880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:42.264880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:42.264880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 429/858] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:42.265232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.282177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d38cf-0b11-44b6-8d5e-584f374276d5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.313981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.320043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.320718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.321007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.321370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.322005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:42.322319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.323765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.328648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 430/859] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:42.336147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.385519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f10d-a8d4-4112-9f4c-a66b93539620 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.425670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.426363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.426649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.426926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.427842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:42.428242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.429820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.434618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.455642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 430/860] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:42.457915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.492352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9807dd-3c65-462a-9d1b-65c36747bf22 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.539038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.539755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.540044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.540326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.541057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:42.541366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.542812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.559218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 431/861] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:42.561504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.580305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.585846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b924-8293-4e0d-b102-e938be5b12d4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.625763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.626903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.627410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.627961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.667569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255669-8c83-40a2-81a8-371e500e9de4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.691846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.704969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.705780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.706491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.706491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.709279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.711052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.713656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.715238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:42.730487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:42.731473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:42.732379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:42.736527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 432/862] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:42.737532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.824523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.830094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 431/863] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 14:55:42.837238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.859499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480135e5-72f1-4f1e-b079-63aeaddc687c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.896584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.898608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.898898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.899208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:42.900006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:42.900315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:42.901765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:42.919364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 433/864] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:42.920963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:42.947078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6deb29d-9ae2-44e5-9bf4-e07446fbe665 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:42.970109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:42.993357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:42.994521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:42.995042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:42.995574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.008234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.010197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:43.031325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:43.032331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:43.033220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:43.033220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:43.033220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:43.033220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:43.041683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 432/865] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:43.043024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:43.046115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56149-7120-45eb-a717-dc39b37f1fd8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:43.082265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:43.083371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.083371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.083371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.084781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=853a5aefa1dc493b9d1b222d3de15156) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:43.085778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.087257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b78874-a233-45f9-a422-f2cafe90c697 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.099297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 434/866] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:42 2022] GET /identity/v3/role_assignments?user.id=853a5aefa1dc493b9d1b222d3de15156&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:43.105981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:43.160780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba13a8b-cd98-41b5-abdd-8c4594268f06 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:43.201865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:43.203460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.203958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.204439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.205389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:43.205927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.207656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.213259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3c1d-44fa-4ebe-8059-be0a81d821df None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.213781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3c1d-44fa-4ebe-8059-be0a81d821df None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.213858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3c1d-44fa-4ebe-8059-be0a81d821df None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.219411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 435/867] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:55:43.221214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.221513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.221802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.224007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 433/868] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:43.231974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:43.243135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:43.244413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:43.331721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 436/869] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:43.354665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:43.357447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee644449-f599-4d17-96ad-adf3392bbee5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:43.370421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:43.403125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:43.403125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.403125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.403125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.408222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.409982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.410843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:43.427486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:43.429002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:43.429889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:43.430314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 434/870] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:43.436115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:43.490102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b34a-6acc-4091-83e2-a50b0e484444 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:43.531506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:43.532248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.532537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.532823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.533622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.535308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.554734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 437/871] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:55:43 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:43.569655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dacfd-353a-483b-b0eb-e19f13e807ff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:43.620487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:43.621324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.621617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.621945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.622817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:43.623211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.624886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d82ac-03e7-4037-bab7-3dea1dbb2ce6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.642944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 435/872] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:43.645958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:43.758625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:43.764581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025566-7cb1-4a23-9180-abe28f4aa30c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:43.804976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:43.805639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:43.805924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:43.806201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:43.807078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=06c3bd6e24f248afa52f13a91c37f47f) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:43.807424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:43.808927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebaaa-de28-4bff-8d69-91343ff4f929 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:43.815385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 438/873] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:43 2022] GET /identity/v3/role_assignments?user.id=06c3bd6e24f248afa52f13a91c37f47f&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:44.639016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242edf-a23c-4276-ad16-9db9a7437012 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:44.639594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242edf-a23c-4276-ad16-9db9a7437012 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:44.639594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242edf-a23c-4276-ad16-9db9a7437012 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:44.641131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 436/874] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:44.646548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f4be-52b7-4ac4-adcb-8c549f2a5019 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:44.647019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f4be-52b7-4ac4-adcb-8c549f2a5019 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:44.647222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f4be-52b7-4ac4-adcb-8c549f2a5019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:44.664998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-79a0f4be-52b7-4ac4-adcb-8c549f2a5019 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:44.666186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-79a0f4be-52b7-4ac4-adcb-8c549f2a5019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:44.741180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 439/875] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:44.763797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242edf-a23c-4276-ad16-9db9a7437012 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:44.797416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:44.880716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242edf-a23c-4276-ad16-9db9a7437012 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:44.918867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d8a0-5de3-4f87-aa34-436138b0a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:44.919482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d8a0-5de3-4f87-aa34-436138b0a041 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:44.919768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d8a0-5de3-4f87-aa34-436138b0a041 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:44.920045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d8a0-5de3-4f87-aa34-436138b0a041 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:44.920783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897d8a0-5de3-4f87-aa34-436138b0a041 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:44.922142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897d8a0-5de3-4f87-aa34-436138b0a041 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:44.939043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 437/876] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:55:44 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:45.490149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a9601-f968-4560-b54d-2820d3b476e6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:45.491061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a9601-f968-4560-b54d-2820d3b476e6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:45.491306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a9601-f968-4560-b54d-2820d3b476e6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:45.492932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 440/877] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:45.498227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:45.498526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:45.498814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:45.516853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:45.518050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:45.596234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 438/878] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:45.619486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a9601-f968-4560-b54d-2820d3b476e6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:45.722756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:45.735779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a9601-f968-4560-b54d-2820d3b476e6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:45.778306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:45.779330 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:45.779615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:45.779891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:45.780551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:45.781933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ae7bd8fe-6e58-445d-8496-59e68d5e6c5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:45.796429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:45.799001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:45.801004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 441/879] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:45.807109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:45.819497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:45.915128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfabf95-5396-4298-9551-b310e6123641 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:45.933063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeceddf-62b4-4ce6-bd92-45cec03ad798 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:45.933367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeceddf-62b4-4ce6-bd92-45cec03ad798 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:45.933608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeceddf-62b4-4ce6-bd92-45cec03ad798 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:45.935252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 442/880] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:55:45.940069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:45.940357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:45.940633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:45.952079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:45.952750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:45.953037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:45.953319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:45.954028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:45.954337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:45.955744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:45.958566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:45.960467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:45.961210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 439/881] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:45.966698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.051450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 443/882] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:46.053189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:46.069692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.077653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc5b5-ea95-4dbc-ab24-b40c9ed066ca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.114197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.114869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.115186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.115501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.116215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:46.116533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:46.117902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9400aa-7baf-4ead-9a21-f36ff9663243 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:46.123012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 440/883] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:46.174815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:46.193397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dcd3a-ff12-410f-bd52-98bd3c731f7b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.216430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d252-90ce-416a-8110-47736e1380ce None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.216750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d252-90ce-416a-8110-47736e1380ce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.216996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d252-90ce-416a-8110-47736e1380ce None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.218628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 441/884] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:46.226242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.226242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.226242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.241900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.243143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.243424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.243711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.244392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:46.245044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:46.245808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:46.246691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:46.259464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:46.260536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:46.261404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 444/885] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:46.268228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.337838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 442/886] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:46.362078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.403426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1da15-465e-42d8-a673-68638ac318f0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.436075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:46.447815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.448914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.449209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.449774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.450505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:46.450818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:46.453000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:46.460225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 445/887] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:46.466725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.476456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f336b-0e40-489f-8366-8cd1c73acd55 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.489959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:46.516883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.518063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.518180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.518385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.530550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:46.539975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:46.540970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:55:46.541825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:46.546378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 443/888] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:46.547702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.592141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe2672-97f5-4e6a-8971-89f926f7221c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.634525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.635500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.637130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.637551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.638631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:46.640239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:46.641828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:46.653174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 446/889] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:46.659905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.690790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1306897-d980-4c0a-85e7-2e9ed54e7a15 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.733920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:46.746558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.747520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.747957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.748383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.749287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:46.749768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:46.752741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:46.766869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 444/890] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:46.781091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:46.853595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:46.905536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56873dda-73a8-4461-83c0-500b5c5d6e48 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.974707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:46.976586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:46.977106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:46.977589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:46.978927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] RBAC: Adding query filter params (interface=public, service_id=1d3b1bd6bb2f4ab49ee584d86b439580, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:46.979490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:46.981902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:46.984212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449124-ccfb-41a4-ba89-42463a33780c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:46.993538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 447/891] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/endpoints?service_id=1d3b1bd6bb2f4ab49ee584d86b439580&interface=public®ion_id=RegionOne => generated 194 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:47.003148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.069137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.071585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.072240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.073072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.106739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.108147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:47.152480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:47.153453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:47.154335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:47.154335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:47.154335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:47.154335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:47.155983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 445/892] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:47.159820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.202811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d2a33-e6cb-422b-934d-e1b303b4aabb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.224090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:47.249382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a20b-1d2e-4fd1-9412-b18de0a64675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.250843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a20b-1d2e-4fd1-9412-b18de0a64675 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.251695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a20b-1d2e-4fd1-9412-b18de0a64675 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.252169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a20b-1d2e-4fd1-9412-b18de0a64675 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.253206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a20b-1d2e-4fd1-9412-b18de0a64675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.255639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a20b-1d2e-4fd1-9412-b18de0a64675 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.263619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 448/893] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:55:46 2022] GET /identity/v3/services => generated 1268 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:55:47.278819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf04bc6-b40b-4667-b22a-107bf75d464f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.279206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf04bc6-b40b-4667-b22a-107bf75d464f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.279421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf04bc6-b40b-4667-b22a-107bf75d464f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.285583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 449/894] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:55:47.287533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.288048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.288595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.302887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de7848-1c31-4dd7-bab0-a77eee952eff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.311503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:47.315707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:47.317720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:47.352994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.353708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.354000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.354284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.355633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:47.355947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.357789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.376045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 446/895] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:47.385192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.420401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 450/896] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:47.443854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.513951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef619b-6bad-49b1-aa32-e2d0f92f67d1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.531455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:47.559724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.560979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.561693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.562129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.564420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcf70-2460-4a9d-84d7-f65ebb6a0472 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.572736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.574899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:47.595400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:47.596622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:47.597814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:47.603728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 447/897] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:47.605665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.615227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.616629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.616917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.617195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.617857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.619733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.623162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:47.636394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:47.637435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:47.638699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 451/898] 10.222.0.45 () {56 vars in 1132 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:47.643650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.753126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb653-b2ca-4e8c-b705-9e57deb970fe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.753456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a78157-249e-4a41-9c57-0ab2ecd1ef04 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.794581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.795458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.795944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.796443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.797929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:47.798469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.800195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.800349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.801227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.801718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.802485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:47.804845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:47.805357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:47.806925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:47.815418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 452/899] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:47.820515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.825930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 448/900] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:47.829296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:47.862398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:47.897444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:47.952377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8d02d-bf2f-4e43-bb91-86d42143a275 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.956845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11590a-7516-4b73-9c6d-4d0b577b01d2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:47.995320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:47.996221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:47.996576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:47.996989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.000117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.001853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.002333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.002799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.003771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:48.004290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.005876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.014135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 453/901] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:48.019028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.075786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.077329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.104066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:48.158062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca2fd-4b6a-48a6-b752-9f589f474a00 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:48.185824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:48.199965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.201011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.201503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.202504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.203865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] RBAC: Adding query filter params (interface=public, service_id=5390164192bd4223a9360a7047edfd7d, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:48.204652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.206993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.215807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 454/902] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:55:48 2022] GET /identity/v3/endpoints?service_id=5390164192bd4223a9360a7047edfd7d&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:48.219346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 449/903] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:47 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:55:48.221768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.223492 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.336178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e1445-24e5-4766-989f-df87897c1caf None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:48.351505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0dd7-a9f3-4867-827e-38305ebda198 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:48.372899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.373679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.374046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.374399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.375210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.376690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.378828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:48.384918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 455/904] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:55:48 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:55:48.394678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.395540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.396152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.396706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.410659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.412073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2cb6977c-3827-41cb-b25c-94ecf5c1711c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:48.436718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:48.437758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:48.439045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:48.439045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:48.439045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:48.439045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:48.439045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 450/905] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:48.446393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.504128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd359-350b-4c6a-a8c5-73024753fb12 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.504470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd359-350b-4c6a-a8c5-73024753fb12 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.504710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd359-350b-4c6a-a8c5-73024753fb12 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.507065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 451/906] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:55:48.512663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373687c-1c04-4992-97af-89e26efd153f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.512986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373687c-1c04-4992-97af-89e26efd153f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.513239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373687c-1c04-4992-97af-89e26efd153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.521708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:48.532907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2373687c-1c04-4992-97af-89e26efd153f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:48.534405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2373687c-1c04-4992-97af-89e26efd153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:48.591226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e29013-15dd-4c62-aa1c-55320995f55e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:48.627483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 452/907] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:48.633715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.634398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.634687 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.634973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.635736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:48.636053 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.637443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.651218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 456/908] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:48.657173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373687c-1c04-4992-97af-89e26efd153f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.660375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.772629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373687c-1c04-4992-97af-89e26efd153f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:48.776232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:48.804780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb8f1e-41a8-45cf-8483-cd77f087f4e2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:48.813736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.814849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.815397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.815882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.825297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.827062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.828095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:48.847755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:48.848688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:48.849602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:48.851730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:48.852674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:48.853159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:48.853643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:48.854548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 453/909] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:48.854803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:48.855780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:48.856824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:48.879171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 457/910] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:55:48 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:48.981236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be33ef8-0980-4323-8230-f25976846395 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:49.027897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:49.028510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:49.028809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:49.029114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:49.029961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:49.030290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:49.031828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27e50e-fd3e-4f02-bc52-2a871ce4ff34 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:49.052478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 454/911] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:49.054107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:49.166326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25ba7d-dcbf-4e64-a0df-775fa6159578 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:49.201792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:49.202455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:49.202744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:49.203025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:49.203906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] RBAC: Adding query filter params (role.id=7df0a179594a4658ab8b462dc601df95, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=06c3bd6e24f248afa52f13a91c37f47f) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:49.204225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:49.205678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12063-af6f-4d8a-b8bd-0db9753f07d3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:49.219249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 458/912] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:49 2022] GET /identity/v3/role_assignments?user.id=06c3bd6e24f248afa52f13a91c37f47f&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=7df0a179594a4658ab8b462dc601df95 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:49.620744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d42ee-9091-4cb2-9e16-03b18c9377c9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:49.621126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d42ee-9091-4cb2-9e16-03b18c9377c9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:49.621324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d42ee-9091-4cb2-9e16-03b18c9377c9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:49.622911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 455/913] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:49.628387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:49.628684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:49.628969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:49.648875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:49.650066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:49.686561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:49.723768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 459/914] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:49.746444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d42ee-9091-4cb2-9e16-03b18c9377c9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:49.770374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:49.856272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d42ee-9091-4cb2-9e16-03b18c9377c9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:49.893318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:49.894047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:49.894334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:49.894623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:49.895314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:49.896837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:49.909676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:49.910691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:49.911599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 456/915] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:49.916970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:50.018720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb7f0-44e8-4e28-8cb5-2284b590cded None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:50.060602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:50.061282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:50.061569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:50.061849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:50.062567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:50.062878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:50.064300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:50.070597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 460/916] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:50.080165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:50.179720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:50.199280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22851f-7908-4f15-8506-52cbec24a28f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:50.236683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:50.237595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:50.238048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:50.238483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:50.239359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:50.239822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:50.242009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99f78e-7511-494c-a16f-035295f95bd3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:50.247476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 457/917] 10.222.0.45 () {56 vars in 1114 bytes} [Thu May 26 14:55:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:50.253808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:50.290241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:50.359821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fdb05-dcb3-4295-8e4e-f0800c1c0ea3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:50.398484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889616ba-b3f5-41f9-a192-39ef991ec4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:50.399178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889616ba-b3f5-41f9-a192-39ef991ec4d8 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:50.399468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889616ba-b3f5-41f9-a192-39ef991ec4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:50.399750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889616ba-b3f5-41f9-a192-39ef991ec4d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:50.400509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889616ba-b3f5-41f9-a192-39ef991ec4d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:50.401896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889616ba-b3f5-41f9-a192-39ef991ec4d8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:50.426642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 461/918] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:55:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:50.749483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497a0b-b31c-4862-aff0-0582373f6d88 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:50.749902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497a0b-b31c-4862-aff0-0582373f6d88 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:50.750088 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497a0b-b31c-4862-aff0-0582373f6d88 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:50.751710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 458/919] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:50.757400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:50.757699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:50.757980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:50.776798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:50.778700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:50.858204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 462/920] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:50.881201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497a0b-b31c-4862-aff0-0582373f6d88 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:50.998432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497a0b-b31c-4862-aff0-0582373f6d88 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.043416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.044249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.044579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.044857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.045519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:51.046889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:51.060563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:51.061528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:51.062359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 459/921] 10.222.0.45 () {56 vars in 1132 bytes} [Thu May 26 14:55:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:51.068186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.093043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:51.180343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e3259-de9d-40a7-bdad-e174bc2dfd71 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.215348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.216072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.216363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.216648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.217375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:51.217684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:51.219069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9bfc8-d658-49ff-80ed-134e19946997 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:51.224360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 463/922] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:51.230319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.251959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:51.309775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ff1b-c8f5-4759-a375-26630a8c7d18 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.310045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ff1b-c8f5-4759-a375-26630a8c7d18 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.310251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ff1b-c8f5-4759-a375-26630a8c7d18 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.311937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 464/923] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:51.317220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.317220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.317543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.335459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:51.336643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:51.351294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a451b-cb62-40b6-a6a8-78884369a02f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.391145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.392169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.392630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.393080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.393990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:51.394291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:51.395834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:51.403244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 460/924] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:51.408970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.439112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 465/925] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:51.459832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.473326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:51.516257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:51.544425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28a3f-b685-4163-b484-1ca61e0708b9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.581475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f15b-c854-460f-8a83-0aa489df4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.582056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f15b-c854-460f-8a83-0aa489df4b32 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.582344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f15b-c854-460f-8a83-0aa489df4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.582622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f15b-c854-460f-8a83-0aa489df4b32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.583065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a37765-082a-409a-a601-326516ea2ed2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.583398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2f15b-c854-460f-8a83-0aa489df4b32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:51.585482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2f15b-c854-460f-8a83-0aa489df4b32 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:51.605398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 461/926] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:55:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:51.606777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979bd36-abdf-48fe-b0cc-cf68caa57f70 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.607103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979bd36-abdf-48fe-b0cc-cf68caa57f70 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.607374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979bd36-abdf-48fe-b0cc-cf68caa57f70 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.608861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 462/927] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:51.614826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dff14-fb85-467c-8712-599bafac896c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.615259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dff14-fb85-467c-8712-599bafac896c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.615512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dff14-fb85-467c-8712-599bafac896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.647374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.648224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.648561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.648851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.649540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:51.651311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:51.652560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-846dff14-fb85-467c-8712-599bafac896c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:51.655078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-846dff14-fb85-467c-8712-599bafac896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:51.667699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:51.668809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:51.669637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:51.674869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 466/928] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:51.675925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.747831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 463/929] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:51.775980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dff14-fb85-467c-8712-599bafac896c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.776884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:51.833374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4033876-953c-4a22-ad0b-b71576f68986 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.879282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:51.882288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.883049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.883369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.883648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:51.884369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:51.884676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:51.888280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:51.895895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 467/930] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:51.901489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:51.938533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dff14-fb85-467c-8712-599bafac896c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:51.988546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:51.989796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:51.991114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:51.991755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.003283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:52.012254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:52.013223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:55:52.014083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:52.022021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 464/931] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 14:55:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:52.023558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.028636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f28d-b302-4d9c-b12d-140aa68970e4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.076180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.076978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.077162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.077479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.078625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:52.079232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.080895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.082586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:52.091229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 468/932] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:52.096569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.144811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439cbf8-2e94-49ce-9468-cb0d1e1d9e86 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.170679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:52.184662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.185608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.185845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.186222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.187077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:52.187514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.188977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.199162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 465/933] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:52.204729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.239458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59cedb-3a87-472f-abe8-3c2a25a65b4f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.277399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.278073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.278363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.278647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.279486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] RBAC: Adding query filter params (interface=public, service_id=cbf3e2c3183e4bf880a1358dec9d8db7, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:52.279803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.281196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.291785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 469/934] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/endpoints?service_id=cbf3e2c3183e4bf880a1358dec9d8db7&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:52.293012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.351714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae9ea-18a6-4f44-af44-d0f10c6737de None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.362794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:52.400543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.401448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.401806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.402217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.413372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41acf-844e-4e96-b9e5-0d60a0b2249e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.414792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.416413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:52.435537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:52.436761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:52.437862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:52.437862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:52.437862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:52.437862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:52.444354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 466/935] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:52.446306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.462340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.462877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.463195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.463485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.464182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.465623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.479263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 470/936] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 14:55:52.492751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:52.573036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496bc0-c4f5-45ca-9efa-2652b4854022 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.613185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.614212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.614707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.615376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.616562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:52.617097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.618709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.633754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 467/937] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:52.639801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.756792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02466-c4a0-48f8-8b1e-eea9beefb579 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.785336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:52.795861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:52.796724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.797015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.797297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.807664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:52.809161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8f6682da-7952-455c-a574-1aa7a63f5333 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:52.825011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:52.826044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:52.826984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 471/938] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:52.834533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:52.862556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1385-ea30-40f3-84d5-72a63b7a1658 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.862884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1385-ea30-40f3-84d5-72a63b7a1658 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.863165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1385-ea30-40f3-84d5-72a63b7a1658 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.864913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 472/939] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:52.872777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:52.873092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:52.873373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:52.891623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:52.892831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:52.952478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:52.960596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eeedd-9216-48f3-bfa3-0dd30890a464 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:52.983130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 473/940] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:53.006438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.007214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.007504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.007787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.008071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.008697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:53.009016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.010533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.031389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 468/941] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 14:55:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:53.037860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.144463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b30785-85a7-4c57-9d60-376c44e89de7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.151408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd61d5-8aaf-4e47-a131-7dd106be4362 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.167433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:53.188657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.189657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.190085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.190464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.190824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.190990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.191251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.191699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.192087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.194344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.196561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING keystone.server.flask.common [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 14:55:53.205163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.206828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.218800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.sql.core [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 14:55:53.218800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 14:55:53.218800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [parameters: {'id': '5971d69ae24a4b47ba49c09025583ceb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 14:55:53.218800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5971d69ae24a4b47ba49c09025583ceb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5971d69ae24a4b47ba49c09025583ceb. May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 14:55:53.227218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 14:55:53.228035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application yield resource May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.rollback() May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.force_reraise() May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise self.value May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application session.commit() May 26 14:55:53.229051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._prepare_impl() May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.flush() May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._flush(objects) May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application compat.raise_( May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application flush_context.execute() May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 14:55:53.229954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rec.execute(self) May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 14:55:53.231529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 14:55:53.232314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [parameters: {'id': '5971d69ae24a4b47ba49c09025583ceb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.233161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:53.235310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5971d69ae24a4b47ba49c09025583ceb. May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 474/942] 10.222.0.45 () {60 vars in 1140 bytes} [Thu May 26 14:55:53 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:53.238800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:53.246733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:53.247785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:53.248663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:53.248663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:53.248663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:53.248663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:53.251649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 469/943] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:53.257478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.274313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:53.381538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437580-692c-4bfb-b894-65e72d64d805 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.405408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe4da-a818-4382-9caf-ac84b51a14d3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.425544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.426930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.427526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.428639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.437672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.440040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.449237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.449989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.450351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.450705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.451537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:53.451922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.453366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:53.459407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:53.460338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:53.461216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:53.472806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 475/944] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:53.476181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 470/945] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:53.480193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.481756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.521226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:53.574886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:53.617076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734204c8-85c5-44fb-9404-2c648839849e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.627754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb309-2de8-41cb-8f2b-0b4282c7143d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.656296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.657043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.657449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.657849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.659255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:53.659679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.661397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.678993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.680833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.681571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.682007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.689755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.691689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.695388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 476/946] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:53.710581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:53.711763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:53.712902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:53.715165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 471/947] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:53.721379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.843664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:53.855660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca0e0-6d9a-42a5-84cb-97a1edaa9399 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:53.896861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:53.897552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.897851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.898149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.899024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:53.899444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:53.900977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad8e7-41cf-47fe-8663-4638ae15061b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:53.914997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 477/948] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:53.921077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:53.966814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f017-d5e2-490a-9c35-a4baae7fb37d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.967182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f017-d5e2-490a-9c35-a4baae7fb37d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.967422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f017-d5e2-490a-9c35-a4baae7fb37d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.969056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 478/949] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:53.974179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:53.974481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:53.975349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:53.993465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:53.994963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:54.042734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b9fe9-ee14-49e9-a468-bd3e617f99a0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:54.066382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 479/950] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:54.074027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:54.085369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:54.086547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:54.087214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:54.087719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/06c3bd6e24f248afa52f13a91c37f47f/roles/7df0a179594a4658ab8b462dc601df95` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:54.089634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:54.090428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=06c3bd6e24f248afa52f13a91c37f47f, role_id=7df0a179594a4658ab8b462dc601df95)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:54.092258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:54.107843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 472/951] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:55:53 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/06c3bd6e24f248afa52f13a91c37f47f/roles/7df0a179594a4658ab8b462dc601df95 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:55:54.186152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:54.208258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6f16b-43c6-4fa6-b5e5-aa61e4f25079 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:54.248080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:54.248899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:54.249184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:54.249464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:54.250133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:54.251593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:54.265318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:54.266640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:54.267594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 480/952] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:54.273394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:54.393738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f4a5-f900-42c8-9240-aace3a59391f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:54.429936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:54.430655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:54.430946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:54.431303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:54.432017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:54.432334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:54.433706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1308d5-719e-440d-9f19-f01a8ccdc802 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:54.439377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 473/953] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:54.445002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:54.554118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50303c6-2815-4b28-868c-8e02961f5854 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:54.590433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:54.591378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:54.591815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:54.592243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:54.593102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:54.593668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:54.595227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8164f-f8f1-4c65-bcbe-43d4d24ac726 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:54.601129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 481/954] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:54.846621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48332c-9924-4573-bb3b-2d9a9322801d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:54.847078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48332c-9924-4573-bb3b-2d9a9322801d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:54.847482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48332c-9924-4573-bb3b-2d9a9322801d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:54.849107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 474/955] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:54.855164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:54.855636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:54.856068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:54.874031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:54.875524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:54.879509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:54.956584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 482/956] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:54.979788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48332c-9924-4573-bb3b-2d9a9322801d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:55.041261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:55.096781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48332c-9924-4573-bb3b-2d9a9322801d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:55.132858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:55.134048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:55.134565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:55.135060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:55.135973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:55.137587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:55.150445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:55.151511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:55.152334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:55.155237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 475/957] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:55.163141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:55.265780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a5e15-be0a-4041-8e66-70d792a66613 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:55.303497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:55.304536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:55.305046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:55.305529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:55.306442 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:55.306969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:55.308587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:55.314209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 483/958] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:55.319874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:55.431417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41025e2b-d0c0-4a79-a06b-ee4d66d2cec7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:55.447240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:55.468907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:55.469581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:55.469863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:55.470138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:55.470851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:55.471185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:55.472553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698b65-7908-4081-bd88-5f181e66b32a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:55.478030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 476/959] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:55.483762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:55.487722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:55.606655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da99be-7518-4110-8c16-24b400d95a99 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:55.643548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca541f-9bd9-4ab4-9d75-f8d1bbb4f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:55.644212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca541f-9bd9-4ab4-9d75-f8d1bbb4f8a4 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:55.644502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca541f-9bd9-4ab4-9d75-f8d1bbb4f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:55.644775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca541f-9bd9-4ab4-9d75-f8d1bbb4f8a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:55.645526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca541f-9bd9-4ab4-9d75-f8d1bbb4f8a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:55.647582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca541f-9bd9-4ab4-9d75-f8d1bbb4f8a4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:55.669238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 484/960] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:55:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:55:56.078112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a51b7-2a8e-4109-ac17-77137bfea47b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.078443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a51b7-2a8e-4109-ac17-77137bfea47b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.078675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a51b7-2a8e-4109-ac17-77137bfea47b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.080320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 477/961] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:56.086333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.086885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.087396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.104878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:56.106420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:56.167283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:56.191186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 485/962] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:56.212674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a51b7-2a8e-4109-ac17-77137bfea47b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:56.323776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a51b7-2a8e-4109-ac17-77137bfea47b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:56.361260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:56.361865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.362150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.362429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.363171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:56.364601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:56.366011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING keystone.server.flask.common [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 14:55:56.378609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.sql.core [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 14:55:56.378609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 14:55:56.378609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [parameters: {'user_id': 'd53ed1e3ec8a445e8cd6e4dfe1bd464c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 14:55:56.378609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80264) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e4cb372f-4fcf-4613-ba40-70b355078b06 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() May 26 14:55:56.396206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 14:55:56.397750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application yield resource May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.rollback() May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.force_reraise() May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise self.value May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application session.commit() May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 14:55:56.399312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._prepare_impl() May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.flush() May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._flush(objects) May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application compat.raise_( May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application flush_context.execute() May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rec.execute(self) May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 14:55:56.400527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 14:55:56.401691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 14:55:56.402789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd53ed1e3ec8a445e8cd6e4dfe1bd464c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:56.403867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 14:55:56.404919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:56.407161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 478/963] 10.222.0.45 () {60 vars in 1131 bytes} [Thu May 26 14:55:56 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:56.414989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:56.510386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5838-9ad6-4db2-b68c-7126dfd754d8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.510903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5838-9ad6-4db2-b68c-7126dfd754d8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.510982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5838-9ad6-4db2-b68c-7126dfd754d8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.517592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 479/964] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:55:56.524318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.524910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.525397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.534031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904362b-52dc-44ca-af8d-80aa10f042db None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:56.543805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:56.545670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:56.577506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:56.578665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.579186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.579690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.588929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:56.590691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:56.592465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:56.610419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:56.611555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 14:55:56.612523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:56.615748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 486/965] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:55:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:56.627126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:56.632986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 480/966] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:55:56.656134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:56.685621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:56.745738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca976-ce5c-4799-a352-d54b55e11d1a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:56.785996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:56.786856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.787370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.788109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.788283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66086aa-61e3-404d-a336-cf6002e1f98a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:56.789235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:56.789659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:56.791543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:56.830733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887be37-5ce8-4bdb-81c3-bc215db98a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:56.831843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887be37-5ce8-4bdb-81c3-bc215db98a94 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.832293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887be37-5ce8-4bdb-81c3-bc215db98a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.832670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 487/967] 10.222.0.45 () {56 vars in 1101 bytes} [Thu May 26 14:55:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:56.832876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887be37-5ce8-4bdb-81c3-bc215db98a94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.845805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887be37-5ce8-4bdb-81c3-bc215db98a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8887be37-5ce8-4bdb-81c3-bc215db98a94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:55:56.856107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:56.857118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:55:56.858004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:56.861096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 481/968] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 14:55:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:56.871259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:56.988891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce24e-8d40-483d-8f9d-9050e62cec50 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.989226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce24e-8d40-483d-8f9d-9050e62cec50 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.989497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce24e-8d40-483d-8f9d-9050e62cec50 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.995232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 482/969] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:56.995874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808a2df-f1e2-4766-b2a4-95ed1a532cc0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:56.997479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:56.997923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:56.998247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:56.999430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:57.017860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:57.019253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:57.050814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:57.064944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.064944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.064944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.065311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:57.067126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:57.067126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:57.068728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:57.081899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 488/970] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:55:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:57.089172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:57.118590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 483/971] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:57.140661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:57.204971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dcd3-a73e-4174-8286-a5405d9df66d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:57.242859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.243844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.244126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.244408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:57.247447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f3bb-548c-453e-9e63-ad5b5b22fb97 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:57.255020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:57.257195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:57.276032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:57.276936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:57.278042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:57.278042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:57.278042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:57.278042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:57.278042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 489/972] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:57.282751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:57.286479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.287858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.288161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.288537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:57.289270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:57.290781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:57.305055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:57.307218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 484/973] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:55:57 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:55:57.407327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9258d4-463d-489f-b865-250e03af9ed5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:57.452262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.453154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.453629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.454103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:57.454972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:57.455424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:57.457098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:57.471990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 490/974] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:57.478853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:57.504859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:57.593156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1728-1fed-45be-aa8f-ac2256aba859 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:57.629085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.629905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.630186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.630460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:57.638861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:57.640333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:55:57.655961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:57.656918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:57.657894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 485/975] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:55:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:57.664032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:57.740392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:57.767827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553adbd-643b-4f69-8acc-facce526e8ed None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:57.803724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.804498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.804854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.805199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:57.806118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:57.806502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:57.808042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a299404-bea9-4d0f-a01a-15395cd76c29 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:57.827344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 491/976] 10.222.0.45 () {56 vars in 1149 bytes} [Thu May 26 14:55:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:57.832193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:57.919820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:57.940795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251f34-d219-4407-b078-f51ad20ea345 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:57.975185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:57.975838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:57.976116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:57.976387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.052362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.054106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.082962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034422e6-434c-4ea9-93d9-b3c064b405c4 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.083298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034422e6-434c-4ea9-93d9-b3c064b405c4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.083580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034422e6-434c-4ea9-93d9-b3c064b405c4 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.085496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 492/977] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:58.091361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.091651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.091930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.109436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:58.110621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:58.144589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:58.169114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 486/978] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:55:57 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:55:58.175220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.184783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 493/979] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:58.206859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.280555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:58.281777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8242-13e7-4485-8a72-19bd110fe22c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.318416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.319239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.319528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.319810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.322000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9446c-f78d-4627-a91c-3dc8444fb53e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.330075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.331550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:55:58.350675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:58.351633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:58.353284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:55:58.353284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:55:58.353284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:55:58.353284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:58.353284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 487/980] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:58.357497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.360731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.361703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.361940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.362245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.362905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.364319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:58.378590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:58.379822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:58.381067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 494/981] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:55:58.386142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.396005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:58.472334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc437-d49e-4a0d-ae28-0b5b78460a8f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.498391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfeb08-a283-40dd-8502-7b645df707b3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.509955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.510628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.510914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.511227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.511963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:58.512268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.513641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.525243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:58.533296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 488/982] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:58.534566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.539914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.540699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.540990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.541268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.541988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:58.542296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.543733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.548650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 495/983] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:58.555433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.638128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:58.648290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50c8e-bf1c-4aa4-9b7c-a30b8fefe998 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.668620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244917f7-747a-467e-8117-74259e77c3ce None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.683402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.684203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.684492 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.684774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.697314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.697314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.708232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.709593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.709984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.710414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.711260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:58.711690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:55:58.713055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:58.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:55:58.715343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:55:58.715882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.718992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 489/984] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:58.719827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.726786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 496/985] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:58.727440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.797726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:58.829538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731172ed-bd30-4fa9-9bf7-a0e88a3eaf49 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.848707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3f12-c01c-4b23-89d9-7b5c4d844441 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:58.874846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.876488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.876974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.877409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.878493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:58.878957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.881385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.884606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:58.885265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:58.885553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:58.885836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:58.886647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] RBAC: Adding query filter params (interface=admin, service_id=cbf3e2c3183e4bf880a1358dec9d8db7, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:58.886961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:58.888355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:58.895178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 497/986] 10.222.0.45 () {56 vars in 1249 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/endpoints?service_id=cbf3e2c3183e4bf880a1358dec9d8db7&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:58.897321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 490/987] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:55:58.903011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.903239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:58.920045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:59.011979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071cae-6865-46a1-aff7-bcdbeadf609b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:59.020300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfa360-5084-4333-b46b-d195a43def76 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:59.035542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:59.055541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ba6c-2c93-4625-873a-f76d30ced7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:59.056312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ba6c-2c93-4625-873a-f76d30ced7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:59.056672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ba6c-2c93-4625-873a-f76d30ced7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:59.056959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ba6c-2c93-4625-873a-f76d30ced7a7 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:59.057652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ba6c-2c93-4625-873a-f76d30ced7a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:59.059042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ba6c-2c93-4625-873a-f76d30ced7a7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:59.061429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:59.062090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:59.062460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:59.062695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:59.063510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] RBAC: Adding query filter params (role.id=7df0a179594a4658ab8b462dc601df95, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=06c3bd6e24f248afa52f13a91c37f47f) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:55:59.063825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:59.065242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498924b5-9842-4357-9437-6aa745deadf8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:59.075621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 498/988] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:55:59.080665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 491/989] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:55:58 2022] GET /identity/v3/role_assignments?user.id=06c3bd6e24f248afa52f13a91c37f47f&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=7df0a179594a4658ab8b462dc601df95 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:55:59.567460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc94ed-1b9c-4ccb-bf55-35f020ccc93f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:59.568008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc94ed-1b9c-4ccb-bf55-35f020ccc93f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:59.568008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc94ed-1b9c-4ccb-bf55-35f020ccc93f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:59.570259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 499/990] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:55:59.575440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:59.575740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:59.576027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:59.601597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:55:59.602796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:55:59.674436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 492/991] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:55:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:55:59.697653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc94ed-1b9c-4ccb-bf55-35f020ccc93f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:59.802383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc94ed-1b9c-4ccb-bf55-35f020ccc93f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:59.837185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:59.837909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:55:59.838201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:55:59.838485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:55:59.839172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:55:59.840556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:55:59.852961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:55:59.854075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:55:59.855020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:55:59.856504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 500/992] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:55:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:55:59.860171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:55:59.868969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:55:59.964782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408b38-e61b-4056-8de8-4670895d7afa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:55:59.999034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:55:59.999722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:00.000011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:00.000293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:00.000999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:00.001309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:00.002675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:00.014104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 493/993] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:55:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:00.014280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:00.065454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:00.121310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42776f-71f3-4f18-8472-e9373225bc5e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:00.156301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:00.157021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:00.157316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:00.157597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:00.158303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:00.158869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:00.160277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:00.165602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 501/994] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:56:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:00.171144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:00.242743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:00.279357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318a5b1-8846-424a-b52a-d0d92ef52917 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:00.315455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:00.316119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:00.316402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:00.316678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:00.317474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] RBAC: Adding query filter params (interface=public, service_id=a210f4847c4b427297dd13bef012a8aa, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:00.317787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:00.319952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b1e1-26fd-4b26-a36f-9531b1996298 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:00.325674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 494/995] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:56:00 2022] GET /identity/v3/endpoints?service_id=a210f4847c4b427297dd13bef012a8aa&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:00.330834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:00.434959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786bc0-cd00-405e-9c89-6d00faca0b5f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:00.445945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:00.470847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0819bd-8663-4177-9011-8dc16006c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:00.471769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0819bd-8663-4177-9011-8dc16006c603 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:00.472207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0819bd-8663-4177-9011-8dc16006c603 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:00.472635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0819bd-8663-4177-9011-8dc16006c603 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:00.473464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0819bd-8663-4177-9011-8dc16006c603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:00.475140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0819bd-8663-4177-9011-8dc16006c603 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:00.482059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 502/996] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:56:00 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:56:01.393151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ea84-870c-4721-be38-1834c09071b2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.393650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ea84-870c-4721-be38-1834c09071b2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.393650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ea84-870c-4721-be38-1834c09071b2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.395186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 495/997] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:01.400664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.401073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.401237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.404221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35e6e-153b-4cbf-a4a2-7cb13e12f8b6 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.404507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35e6e-153b-4cbf-a4a2-7cb13e12f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.404782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e35e6e-153b-4cbf-a4a2-7cb13e12f8b6 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.406213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 496/998] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:56:01.411144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.411437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.411710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.419490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:01.420690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:01.429835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:01.430979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:01.494493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 503/999] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:01.502933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 497/1000] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:01.516717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:01.527731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:01.601655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:01.626720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c34fc-093d-4bc9-ae1d-523c04cd5847 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:01.629240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:01.645753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a04de-ead0-43cd-bede-2659e81a1d37 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:01.665943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:01.666740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.667027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.667729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.668181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:01.669583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:01.682303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:01.683139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.683430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.683710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.684363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:01.684520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:01.685483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:01.686880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:01.687680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:01.687753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 504/1001] 10.222.0.45 () {56 vars in 1105 bytes} [Thu May 26 14:56:01 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:01.691711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:01.703857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:01.704894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 14:56:01.705742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:01.706479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 498/1002] 10.222.0.45 () {56 vars in 1126 bytes} [Thu May 26 14:56:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:01.711471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:01.800863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74bf6-2865-4ffd-a114-a4152d252681 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:01.818647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b6289-b6ca-4384-944f-5a6eba760d0b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:01.838137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:01.838813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.839125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.839416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.840139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:01.840470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:01.841933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:01.847102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 505/1003] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:01.847235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:01.853503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:01.857137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:01.857806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.858094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.858375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.859102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:01.859434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:01.860792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:01.871294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 499/1004] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:56:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:01.871920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:01.886184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:01.960916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b95df-23f9-4a19-9c33-fc60d6b10fa2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:01.979968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1832a-7e0e-4615-831a-b1f3330a0d3a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:01.996760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:01.997438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:01.997732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:01.998019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:01.998735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:01.999047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:02.000481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:02.015112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 506/1005] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:02.015806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:02.016496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:02.016782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:02.017063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:02.017788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:02.018098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:02.019544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935042c7-3ed9-467d-b111-e2e0d538b69c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:02.026233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 500/1006] 10.222.0.45 () {56 vars in 1122 bytes} [Thu May 26 14:56:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:02.031927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:02.140053 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:02.147321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30680e6-1698-453d-9620-2fb617c7c777 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:02.187771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bff71-6dd8-404d-a448-88383f41a117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:02.188448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bff71-6dd8-404d-a448-88383f41a117 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:02.188736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bff71-6dd8-404d-a448-88383f41a117 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:02.189015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bff71-6dd8-404d-a448-88383f41a117 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:02.189781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bff71-6dd8-404d-a448-88383f41a117 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:02.191300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bff71-6dd8-404d-a448-88383f41a117 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:02.210436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 507/1007] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:56:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:02.757766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8822be-bd74-41b7-9609-4f8541103830 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:02.758293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8822be-bd74-41b7-9609-4f8541103830 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:02.758293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8822be-bd74-41b7-9609-4f8541103830 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:02.760034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 501/1008] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:02.765531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:02.765985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:02.766156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:02.784071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:02.785283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:02.861910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 508/1009] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:02.884495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8822be-bd74-41b7-9609-4f8541103830 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:02.942018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:02.987482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8822be-bd74-41b7-9609-4f8541103830 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:03.022480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:03.023226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:03.023509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:03.023781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:03.024428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:03.025813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:03.048114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:03.049111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:03.054916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 502/1010] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:56:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:03.057621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:03.142499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:03.163552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80b562-1c81-4110-b98d-0fa159da775e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:03.197966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:03.198637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:03.198922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:03.199231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:03.199942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:03.200249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:03.201626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:03.206724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 509/1011] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:56:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:03.212914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:03.314696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d03b6-11fc-4d76-8390-0a945400f69c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:03.335680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:03.352749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:03.353430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:03.353709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:03.353988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:03.354705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:03.355005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:03.356398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d3ef-eeb7-4a55-988e-c8af36a44a16 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:03.366366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 503/1012] 10.222.0.45 () {56 vars in 1112 bytes} [Thu May 26 14:56:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:03.367621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:03.473453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc658a28-4c9e-4d9a-afdd-266cbd519529 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:03.509141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e42ea-082b-4c11-bcfa-633ff8773754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:03.509805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e42ea-082b-4c11-bcfa-633ff8773754 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:03.510094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e42ea-082b-4c11-bcfa-633ff8773754 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:03.510372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e42ea-082b-4c11-bcfa-633ff8773754 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:03.511138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e42ea-082b-4c11-bcfa-633ff8773754 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:03.512553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e42ea-082b-4c11-bcfa-633ff8773754 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:03.539126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 510/1013] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:56:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:04.239167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1650d-4490-4f9d-a07a-4ef3e0924315 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.239688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1650d-4490-4f9d-a07a-4ef3e0924315 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.239765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1650d-4490-4f9d-a07a-4ef3e0924315 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.241196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 504/1014] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:04.246375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d94-19fe-466f-955b-b8a0b34e8e5d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.246786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d94-19fe-466f-955b-b8a0b34e8e5d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.246955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d94-19fe-466f-955b-b8a0b34e8e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.252179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:04.265819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-96cb6d94-19fe-466f-955b-b8a0b34e8e5d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:04.267017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-96cb6d94-19fe-466f-955b-b8a0b34e8e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:04.347821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 511/1015] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:04 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:04.370601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1650d-4490-4f9d-a07a-4ef3e0924315 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:04.477466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1650d-4490-4f9d-a07a-4ef3e0924315 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:04.487639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424626f-176d-437f-bb53-2f74501a813e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.487934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424626f-176d-437f-bb53-2f74501a813e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.488215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424626f-176d-437f-bb53-2f74501a813e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.489596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 512/1016] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:56:04.494996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.495599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.496030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.512546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:04.513210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.513496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.513775 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.514069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:04.514502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:04.515489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:04.515896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:04.534472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 505/1017] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:56:04 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:04.606249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 513/1018] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:04.630312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:04.688328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:04.750097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f80310-fb41-4e4a-ab66-4884c439dddb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:04.789067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026928b-abfa-418c-9b0e-81a6c4bd6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:04.789871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026928b-abfa-418c-9b0e-81a6c4bd6ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.790161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026928b-abfa-418c-9b0e-81a6c4bd6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.790440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026928b-abfa-418c-9b0e-81a6c4bd6ab0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.791634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026928b-abfa-418c-9b0e-81a6c4bd6ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:04.793068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026928b-abfa-418c-9b0e-81a6c4bd6ab0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:04.794691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 506/1019] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:04.800981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:04.857337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:04.904955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe28c-7c26-4011-a522-443b1570c788 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:04.940997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d255-c01b-4f97-8729-6c54871dbd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:04.941665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d255-c01b-4f97-8729-6c54871dbd70 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:04.941951 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d255-c01b-4f97-8729-6c54871dbd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:04.942228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d255-c01b-4f97-8729-6c54871dbd70 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:04.942975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d255-c01b-4f97-8729-6c54871dbd70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:04.944998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d255-c01b-4f97-8729-6c54871dbd70 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:04.973321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 514/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:56:04 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:56:05.918226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226cf6e-507c-4f0a-be57-46412b581350 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:05.918754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226cf6e-507c-4f0a-be57-46412b581350 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:05.918862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226cf6e-507c-4f0a-be57-46412b581350 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:05.920346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 507/1021] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:05.925424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:05.925804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:05.926000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:05.944645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:05.945900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:06.016244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 515/1022] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:06.040455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226cf6e-507c-4f0a-be57-46412b581350 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:06.149365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226cf6e-507c-4f0a-be57-46412b581350 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:06.163873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:06.186993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:06.187764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.188049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.188327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.199105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:06.207428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:06.208381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:56:06.209947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:06.213654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 508/1023] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:06.215024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:06.253320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:06.325533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02328ed-43dc-4a37-aba0-9433f2a63142 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:06.361502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:06.362180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.362469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.362752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.363539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:06.363853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:06.365564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:06.378398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 516/1024] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:06.380151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:06.485311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d5bb8-f83e-4fb8-8fe6-7ebf22f786b2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:06.518495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:06.519325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.519616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.519898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.531921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:06.533376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:06.550893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:06.551962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:06.558507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:06.558507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:06.558507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:06.558507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:06.558507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 509/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:06.560366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:06.666747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:06.672109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729563d4-028b-45a5-be90-796b9b9352c1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:06.707387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:06.708066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.708356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.708675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.709409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:06.709718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:06.711125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511056d-990b-47ff-b020-a4967fc09c4c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:06.728528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 517/1026] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:06.729818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:06.757760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:06.819880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a156a-8748-4d02-bc48-19c3d83116cd None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.820231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a156a-8748-4d02-bc48-19c3d83116cd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.820454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a156a-8748-4d02-bc48-19c3d83116cd None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.822078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 518/1027] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:06.826971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.827300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.827581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.841569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7c9b2-0de1-4b19-83b1-9870b47fd3b5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:06.844524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:06.845705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:06.875691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:06.876489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:06.876778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:06.877059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:06.885851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:06.887365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:56:06.902522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:06.903596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:06.905200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 510/1028] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:06.909568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:06.921122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 519/1029] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:06.943963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.000211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.018790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093eea-323e-4b70-9ff8-e4f8e841cbd1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.040843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.056295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6d78-c71d-47e5-8cdf-9b58a1c5ee34 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.066036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.066736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.067022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.067393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.068910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:07.069243 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.070698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.089476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 511/1030] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:07.095040 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.101661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.102467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.102756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.103033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.103730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.105118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:07.118211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:07.119379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:07.120375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 520/1031] 10.222.0.45 () {56 vars in 1105 bytes} [Thu May 26 14:56:06 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:07.128177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.202880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0d07-6935-4ad9-8535-0170c2d36c93 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.236860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304600-ce49-494c-8018-5bb75c59b75f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.239156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410440-b53b-4439-b42f-0dcc705c8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.239860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410440-b53b-4439-b42f-0dcc705c8b9a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.240178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410440-b53b-4439-b42f-0dcc705c8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.240466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410440-b53b-4439-b42f-0dcc705c8b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.252946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.273784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.274390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.274677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.274957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.275697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:07.276009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.277389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65029098-4ece-499a-9a39-6b58b36799fc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.282227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 521/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:07.283455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c474f-62a5-4066-8435-39c68017f31f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.283996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c474f-62a5-4066-8435-39c68017f31f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.284273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c474f-62a5-4066-8435-39c68017f31f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.285653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 522/1033] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:07.290793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c474f-62a5-4066-8435-39c68017f31f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.308678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.311346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410440-b53b-4439-b42f-0dcc705c8b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.312805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410440-b53b-4439-b42f-0dcc705c8b9a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.391645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c474f-62a5-4066-8435-39c68017f31f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.415876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 512/1034] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 14:56:07.417178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.417468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.417744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.432100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.432793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.433077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.433354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.434056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:07.434358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.434450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:07.435596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:07.435752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.440664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 523/1035] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:07.441503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.475733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.508261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 513/1036] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:07.519253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.525659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.547294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75217dc-89dc-42cb-99bf-00d103788aae None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.582414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.583243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.584525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.584810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.594826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.596319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.608161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986051e-6ca3-4fa8-a65d-0dacb1af2706 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:07.613793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:07.614944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:07.615979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:07.615979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:07.615979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:07.615979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:07.615979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 524/1037] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:07.615979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.644224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.644875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.645159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.645434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.646790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] RBAC: Adding query filter params (interface=public, service_id=bdb6d68f2a4a473cb05cacfbf0a21fb8, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:07.647117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.648481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.653431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 514/1038] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/endpoints?service_id=bdb6d68f2a4a473cb05cacfbf0a21fb8&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:07.654198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.691720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.731736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94c03-3ed4-4d0d-9de3-cdb65170c56d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.758795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65008731-941c-4a5e-97b8-6f4a4d0ee539 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.761609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.768358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.769148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.769434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.769711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.770869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.773571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.775221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 525/1039] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:07.776033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.794673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.795367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.795652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.795941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.796663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:07.796972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.798334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.814663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 515/1040] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:07.814663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.879475 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19e9c8-2588-4aff-98d2-0daf82589284 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.906515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:07.913668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23a52-9a18-4368-9b57-d45bf64c45f0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:07.914257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.914936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.915258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.915549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.916248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.917630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:07.924171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 526/1041] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:56:07.924953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:07.962384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:07.963202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:07.963489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:07.963768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:07.964605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:07.966083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:08.003126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 516/1042] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:56:07 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:08.004151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:08.052131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8d560-527c-4616-a1f4-8e27b9bc9057 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:08.094637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:08.095489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:08.095929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:08.096220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:08.104561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:08.106211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:56:08.122412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:08.123440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:56:08.124354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:08.126246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 527/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:08.129743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:08.247635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79ab3-bb2e-4f5b-8793-16e3a9890a6a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:08.283798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:08.284470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:08.284755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:08.285034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:08.285824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:08.286136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:08.288130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60afb52-a109-4233-a39b-c22a20b6b814 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:08.301201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 517/1044] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:08.307020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:08.412192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6949e-01a9-43d6-9b41-6d0470569888 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:08.436278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:08.448269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:08.448935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:08.449223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:08.449501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:08.450340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] RBAC: Adding query filter params (role.id=7df0a179594a4658ab8b462dc601df95, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=6351122de1824cdf901a0943f64a1b53) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:08.450654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:08.452136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e35ab-3340-4fc8-babb-acb2bae2d392 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:08.460731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 528/1045] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:08 2022] GET /identity/v3/role_assignments?user.id=6351122de1824cdf901a0943f64a1b53&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=7df0a179594a4658ab8b462dc601df95 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:10.214487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231db717-6469-4f52-a294-b47f3681e4a0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.215008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231db717-6469-4f52-a294-b47f3681e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.215008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231db717-6469-4f52-a294-b47f3681e4a0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.216488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 518/1046] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:10.221550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.221931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.222113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.240188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:10.241908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:10.295501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d39b6-195d-4ca2-ad55-d428c9cd2727 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.295884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d39b6-195d-4ca2-ad55-d428c9cd2727 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.296220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d39b6-195d-4ca2-ad55-d428c9cd2727 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.297635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 519/1047] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:56:10.303236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.303528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.303803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.315826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 529/1048] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:10.321260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:10.322431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:10.330765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:10.339257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.397987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 520/1049] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:10.422052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.467621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629019c-21e7-4278-bbea-99905288cbf5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.492225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:10.514872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.515708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.516000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.516442 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.517041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:10.518428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:10.530826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:10.532001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 14:56:10.532824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:10.533824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77c86-4991-446b-8e28-d0072af97771 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.533901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 530/1050] 10.222.0.45 () {56 vars in 1105 bytes} [Thu May 26 14:56:10 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:10.538560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.573006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.573724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.574008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.574281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.586213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:10.594577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:10.595668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:10.596759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 521/1051] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:10.602917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.605874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:10.648066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3a09b-13c8-42dd-81a2-3ab7d040e1b8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.684192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.684896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.685181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.685461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.686174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] RBAC: Adding query filter params (name=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:10.686496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:10.687909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3d4d-a32d-4a57-ae6b-94fc599c25ff None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:10.692862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 531/1052] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:10.698018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837af27a-2036-4420-8ba9-e58d81215d23 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.699549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837af27a-2036-4420-8ba9-e58d81215d23 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.699836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837af27a-2036-4420-8ba9-e58d81215d23 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.701494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 532/1053] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:10.702450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837af27a-2036-4420-8ba9-e58d81215d23 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.715489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f876b-9ede-4576-87aa-09a2e9c72f4a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.749672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.750336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.750619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.750968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.751178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:10.751747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:10.752054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:10.753485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4402f-e8a2-4aea-a816-62942b996bca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:10.761854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 522/1054] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:10.763287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.763646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.763923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.785350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:10.787681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:10.811157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837af27a-2036-4420-8ba9-e58d81215d23 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.845618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.845814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:10.846255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.846571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.846780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.847713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:10.848026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:10.850207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:10.855121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 533/1055] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:10.855470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 523/1056] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:10.855948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.860685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:10.954999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6dd4d-50cf-4800-bcf8-59517851f8a8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.961848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0aee8-eb18-489c-8f9f-7311bdbf8ef0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:10.966404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:10.991349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.992512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.992806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.993087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] PATH_INFO: `/v3/users/b4078ada5820489cb0a2dffae8485cd9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.996994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:10.997684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:10.997973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:10.998256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:10.999000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.000419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.007060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] RBAC: Authorizing `identity:get_user(user_id=b4078ada5820489cb0a2dffae8485cd9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.008536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.010285 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 534/1057] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:10 2022] GET /identity/v3/users/b4078ada5820489cb0a2dffae8485cd9 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:11.011194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.021337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 524/1058] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:56:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:56:11.022464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.081381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:11.146150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3dbd-2abc-45c9-a4d5-109b4989d2c5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.152845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a21619-673b-4b78-b494-9386bad981f2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.186424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.187296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.187585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.187865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.192876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.193854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.194299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.194732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.199994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:11.208342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:11.209718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:11.210874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 535/1059] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:11.215835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.248240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:11.276631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.278621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.327327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:11.333130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814e79-c8ce-419a-82d3-26e9cab1ef3d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.369147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.370101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.370395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.370678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.371476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:11.371782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.373163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.382820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 536/1060] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:11.388510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.389965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 525/1061] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:11.397168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.492484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:11.502355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde304-00a4-42c4-927b-d9ccf2c2459d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.503701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e653e93-261e-427a-9d2e-e3aa9cf5295a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.539760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.540566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.540851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.541130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.544737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.545607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.545894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.546170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.547374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b778d41a8548a0abbf8020dd1834d8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.548808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.553583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 526/1062] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:11.557281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.558076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.558814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.575940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:11.576786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:11.577798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:11.578964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:11.578964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:11.578964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:11.578964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:11.578964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 537/1063] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:11.583690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.673145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5096-e9db-41c1-a5aa-46c7cc5ab373 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.708347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e7654-34d5-44f8-a81f-a8e3ac3db00e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.720036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.720795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.721146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.721501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.722413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=f8b778d41a8548a0abbf8020dd1834d8, user.id=b4078ada5820489cb0a2dffae8485cd9) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:11.722733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.724229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.730009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 527/1064] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/role_assignments?user.id=b4078ada5820489cb0a2dffae8485cd9&scope.project.id=f8b778d41a8548a0abbf8020dd1834d8&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:11.750277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.750967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.751288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.751595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.752342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:11.752652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.754076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.769106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 538/1065] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:11.774864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.862686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:11.889339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c109a0-110b-41f5-87ab-6ac8560a6600 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:11.929230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:11.929951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:11.930235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:11.930510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:11.938373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:11.939832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:56:11.953987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:11.955048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:11.956049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 528/1066] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:11.962858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:11.965841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:12.075025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36758924-8967-4310-b9b4-b4e0f1b76533 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:12.109754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:12.110446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:12.110731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:12.111008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:12.111883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:12.112199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:12.113636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:12.136232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 539/1067] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:56:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:12.137707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:12.243681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea903a3-6327-4bc4-9562-109383e331bd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:12.278852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:12.279688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:12.279972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:12.280249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:12.287793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:12.293022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:12.294475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:12.312434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:12.313384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:12.314299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:12.314299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:12.314299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:12.314299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:12.314299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 529/1068] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:12.321072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:12.381713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:12.423599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779d30-3b8f-4bc7-a124-37188cd3410e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:12.458071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:12.459296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:12.459582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:12.459940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:12.460676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:12.460982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:12.462358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:12.474001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 540/1069] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:12.480099 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:12.585613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c49c-1b29-4d15-9faf-9af75785e7c2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:12.619555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:12.620360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:12.620649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:12.620930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:12.627591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:12.629027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:56:12.643310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:12.644205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:12.650538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 530/1070] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:56:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:12.651073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:12.755113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64fec0-b945-4671-a8e9-44b7dcac0110 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:12.776141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:12.792735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:12.793401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:12.793693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:12.793972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:12.794770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:12.795106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:12.796552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa54e08-211f-489e-8744-dda4e186b8d0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:12.809714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 541/1071] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:12.815452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:12.869143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:12.921854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156a23-3c64-4759-9610-3d145b6bd461 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:12.956552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000ab7-df4e-40d3-930a-f62b912a945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:12.957444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000ab7-df4e-40d3-930a-f62b912a945d None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:12.957724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000ab7-df4e-40d3-930a-f62b912a945d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:12.957996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000ab7-df4e-40d3-930a-f62b912a945d None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/6351122de1824cdf901a0943f64a1b53/roles/7df0a179594a4658ab8b462dc601df95` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:12.960300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000ab7-df4e-40d3-930a-f62b912a945d None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=6351122de1824cdf901a0943f64a1b53, role_id=7df0a179594a4658ab8b462dc601df95)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:12.961749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000ab7-df4e-40d3-930a-f62b912a945d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:12.975131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 531/1072] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:56:12 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/6351122de1824cdf901a0943f64a1b53/roles/7df0a179594a4658ab8b462dc601df95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:56:13.300995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e8136-6b79-4e5c-a350-285f09ca9a7f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:13.301336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e8136-6b79-4e5c-a350-285f09ca9a7f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:13.301573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e8136-6b79-4e5c-a350-285f09ca9a7f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:13.303900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 542/1073] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:13.309051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:13.309508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:13.309593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:13.326909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:13.328124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:13.400150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 532/1074] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:13.423009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e8136-6b79-4e5c-a350-285f09ca9a7f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:13.526862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e8136-6b79-4e5c-a350-285f09ca9a7f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:13.562315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:13.562889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:13.563200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:13.563485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:13.613196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:13.634242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:13.635749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:13.749163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 543/1075] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:13.750461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:13.798234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:13.859673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555cb6-5ecb-4bc5-9552-9b722eb1c7e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:13.894403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:13.895220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:13.895507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:13.895895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:13.906120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:13.907581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2adcdd62-6d4d-411f-b64e-7c126f8cc56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:13.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:13.926134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:13.927605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:13.927605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:13.927605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:13.927605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:13.927605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 533/1076] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:13.933434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:13.970478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219c30-0d7a-4029-a405-142425a49003 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:13.970812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219c30-0d7a-4029-a405-142425a49003 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:13.971039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50219c30-0d7a-4029-a405-142425a49003 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:13.972585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 534/1077] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:56:13.977441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:13.977734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:13.978077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:13.995032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:13.996249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:14.023752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:14.049123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a668a33-5212-4c45-905e-5113be116d0a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:14.083126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 535/1078] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:14.087753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:14.088428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:14.088719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:14.089004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:14.089776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:14.090092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:14.091523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:14.104027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:14.115208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 544/1079] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:14.141538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:14.232631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ed559-875a-4788-8110-ef49aa9f0014 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:14.271409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:14.272236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:14.272515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:14.272784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:14.284344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:14.293502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:14.294477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:14.295364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 536/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:14.300897 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:14.413867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f8c3-b7b8-4b89-87fb-020639faad83 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:14.448428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:14.449105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:14.449396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:14.449680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:14.450436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:14.450750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:14.452164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:14.460531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 545/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:14.466374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:14.548624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:14.567284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661a4d4-a1c6-4f02-ad77-1ffa8d275746 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:14.601598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:14.602469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:14.602755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:14.603034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] PATH_INFO: `/v3/users/b4078ada5820489cb0a2dffae8485cd9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:14.604241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] RBAC: Authorizing `identity:get_user(user_id=b4078ada5820489cb0a2dffae8485cd9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:14.605669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:14.607544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 537/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:14 2022] GET /identity/v3/users/b4078ada5820489cb0a2dffae8485cd9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:14.612987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:14.616229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:14.714223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b442b16-dacc-4fb2-9139-75d468335230 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:14.747487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df961403-8bac-4710-9465-2aeca5b75161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:14.748351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df961403-8bac-4710-9465-2aeca5b75161 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:14.748640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df961403-8bac-4710-9465-2aeca5b75161 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:14.748924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df961403-8bac-4710-9465-2aeca5b75161 None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:14.750107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df961403-8bac-4710-9465-2aeca5b75161 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b778d41a8548a0abbf8020dd1834d8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:14.751597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df961403-8bac-4710-9465-2aeca5b75161 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:14.753316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 546/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:14 2022] GET /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:14.759628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:14.867536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f355bee-e06e-4094-8b24-f7fba12624ad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:14.900694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fe634-99c0-4477-81bc-671fb36048fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:14.901579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fe634-99c0-4477-81bc-671fb36048fe None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:14.901862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fe634-99c0-4477-81bc-671fb36048fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:14.902139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fe634-99c0-4477-81bc-671fb36048fe None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8/users/b4078ada5820489cb0a2dffae8485cd9/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:14.904117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fe634-99c0-4477-81bc-671fb36048fe None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b778d41a8548a0abbf8020dd1834d8, user_id=b4078ada5820489cb0a2dffae8485cd9, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:14.905546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fe634-99c0-4477-81bc-671fb36048fe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:14.918230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 538/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:56:14 2022] PUT /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8/users/b4078ada5820489cb0a2dffae8485cd9/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:56:15.251374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db95aa-b4eb-4fdf-9bbf-85d82610881d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:15.251784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db95aa-b4eb-4fdf-9bbf-85d82610881d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:15.252071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db95aa-b4eb-4fdf-9bbf-85d82610881d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:15.253470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 547/1085] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:15.259528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:15.259825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:15.260110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:15.277536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:15.278720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:15.281568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:15.347484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 539/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:15.371099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db95aa-b4eb-4fdf-9bbf-85d82610881d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:15.443366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:15.476345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db95aa-b4eb-4fdf-9bbf-85d82610881d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:15.511765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:15.512574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:15.512863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:15.513140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:15.523312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:15.531498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:15.532660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:15.533796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 548/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Thu May 26 14:56:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:15.538957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:15.637634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486ab6d-eece-4791-b683-5c062f628161 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:15.671551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:15.672222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:15.672511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:15.672792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:15.673538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:15.673849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:15.675247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:15.684066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 540/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:56:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:15.689642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:15.792605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbbbcd-dea9-4c55-9791-8081b6a0f55e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:15.821566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:15.828092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:15.828891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:15.829186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:15.829467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:15.839953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:15.841406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:15.859235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:15.860144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:15.861039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:15.861039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:15.861039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:15.861039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:15.861039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 549/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:15.866910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:15.869764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:15.967399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60ad5f-d1ef-4447-a535-401da0c47d96 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:16.001721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:16.002377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:16.002663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:16.002938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:16.003690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:16.003996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:16.005408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:16.017698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 541/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:16.024346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:16.135271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ebce-44b1-41d1-8167-dfa3473fdfc0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:16.169551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:16.170342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:16.170628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:16.170907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:16.178527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:16.180002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:56:16.193998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:16.196115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:16.197767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 550/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Thu May 26 14:56:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:16.200827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:16.263399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:16.302851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd40900-e988-4d49-9699-1ed152f4f562 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:16.339602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:16.340268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:16.340549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:16.340826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:16.341653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:16.341956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:16.343387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:16.361313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 542/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Thu May 26 14:56:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:16.367521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:16.414660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:16.471871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921be49-9245-449d-a61c-e16b8f5a4b75 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:16.504558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:16.505841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:16.506558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:16.506840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:16.574339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:16.575821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:16.617741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:16.675697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 551/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:16.681929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:16.782208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0a01-48ab-4706-b51e-73a3e56a0b5e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:16.803891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:16.819250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:16.820048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:16.820334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:16.820613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:16.830586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:16.831992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:16.849292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:16.850367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:16.851362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:56:16.851362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:16.851362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:56:16.851362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:16.851362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 543/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:16.856240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:16.957037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b663-53e0-4fa8-b43f-2e726ee334a8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:16.996302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:16.997079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:16.997372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:16.997697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:16.998479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:16.998829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.000427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478fa6-bbf8-4092-be61-7e7fe409d1d1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:17.012831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 552/1095] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:17.018339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.123437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa559e1-7bee-4faa-9828-710879c6b4e0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.146249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9b5b-e372-472a-b977-9bab04ae500f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.146620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9b5b-e372-472a-b977-9bab04ae500f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.146908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9b5b-e372-472a-b977-9bab04ae500f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.148364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 553/1096] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 14:56:17.153281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.153577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.153866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.158837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.159288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:17.159692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.160003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.160295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.168777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.170299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:17.172959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:17.174142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:56:17.185298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:17.186380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:17.187371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 544/1097] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:17.192289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.224460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:17.244638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 554/1098] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:17.267840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.295543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14fba-c722-46fa-a689-83b0b594fed6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.329466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.330133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.330415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.330694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.331871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:17.332188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.334373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:17.346369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 545/1099] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:17.352451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.374852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc059c6-3169-43b4-a32a-c568d3f8a03d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.405434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:17.411508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.412296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.412582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.412858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.423297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:17.431365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:17.432332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:17.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 555/1100] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:56:17.438988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.446617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:17.455829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0be833-eca3-4cf3-b1f2-c21608f1cbe8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.490567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.491405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.491725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.492047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.493051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] RBAC: Adding query filter params (role.id=7df0a179594a4658ab8b462dc601df95, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=6351122de1824cdf901a0943f64a1b53) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:17.493405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.495069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:17.502239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 546/1101] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/role_assignments?user.id=6351122de1824cdf901a0943f64a1b53&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=7df0a179594a4658ab8b462dc601df95 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:17.549414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060cbab-2609-48e9-baaf-584600bedfb0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.586801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.587562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.587850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.588131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.588898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:17.589209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.590613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:17.600092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 556/1102] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:56:17.606121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.723953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8041-8ae1-41e2-bb28-917d20a9892e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.759560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.760443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.760729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.761079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] PATH_INFO: `/v3/users/b4078ada5820489cb0a2dffae8485cd9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.762347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=b4078ada5820489cb0a2dffae8485cd9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.764923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:17.768169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 547/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/users/b4078ada5820489cb0a2dffae8485cd9 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:17.774163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:17.840545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:17.886833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379973e-7ff9-4754-97b9-8858c0e19c3e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:17.921175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:17.921825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:17.922110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:17.922387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:17.995677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:17.997070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:18.055217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:18.104367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 557/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:18.110066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:18.138854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:18.217632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d75bb-9af9-4e3a-bbdf-fffd16fa0ac9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:18.253466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2c88-987d-463c-878e-c34ccf328b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:18.254245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2c88-987d-463c-878e-c34ccf328b5d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:18.254524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2c88-987d-463c-878e-c34ccf328b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:18.254794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2c88-987d-463c-878e-c34ccf328b5d None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:18.256707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b2c88-987d-463c-878e-c34ccf328b5d None admin] RBAC: Authorizing `identity:get_project(project_id=f8b778d41a8548a0abbf8020dd1834d8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:18.258144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b2c88-987d-463c-878e-c34ccf328b5d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:18.259914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 548/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:18 2022] GET /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:18.266411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:18.370342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1285953-1c9f-41ea-b5df-94c056a3b298 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:18.405810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:18.406476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:18.406769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:18.407144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:18.408066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=f8b778d41a8548a0abbf8020dd1834d8, user.id=b4078ada5820489cb0a2dffae8485cd9) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:18.408657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:18.410175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0126-8449-4797-b4a2-fa456d392c76 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:18.416224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 558/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:18 2022] GET /identity/v3/role_assignments?user.id=b4078ada5820489cb0a2dffae8485cd9&scope.project.id=f8b778d41a8548a0abbf8020dd1834d8&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:20.654599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e9a1e-c1f7-4b49-8552-814e0df37a06 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:20.655154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e9a1e-c1f7-4b49-8552-814e0df37a06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:20.655247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e9a1e-c1f7-4b49-8552-814e0df37a06 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:20.656653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 549/1107] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:20.662239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:20.662665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:20.662808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:20.679889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:20.681075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:20.694919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:20.748799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 559/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:20.777245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e9a1e-c1f7-4b49-8552-814e0df37a06 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:20.869990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:20.879683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e9a1e-c1f7-4b49-8552-814e0df37a06 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:20.915074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456502-5f76-49e8-ae49-4e3a2f63a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:20.915832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456502-5f76-49e8-ae49-4e3a2f63a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:20.916114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456502-5f76-49e8-ae49-4e3a2f63a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:20.916387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456502-5f76-49e8-ae49-4e3a2f63a6f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:20.917525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456502-5f76-49e8-ae49-4e3a2f63a6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:20.918939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456502-5f76-49e8-ae49-4e3a2f63a6f7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:20.920555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 550/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:20.926219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:21.023558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e00d4-690a-42d4-9c67-b8a6d59d263c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:21.058342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9917c86-e452-4195-a91e-2d887e250797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:21.059010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9917c86-e452-4195-a91e-2d887e250797 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:21.059335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9917c86-e452-4195-a91e-2d887e250797 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:21.059616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9917c86-e452-4195-a91e-2d887e250797 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:21.060329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9917c86-e452-4195-a91e-2d887e250797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:21.061769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9917c86-e452-4195-a91e-2d887e250797 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:21.080984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 560/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:56:20 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:23.405369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536efefc-a00c-49a2-a6cc-b7406cdbdd59 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:23.405890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536efefc-a00c-49a2-a6cc-b7406cdbdd59 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:23.405890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536efefc-a00c-49a2-a6cc-b7406cdbdd59 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:23.407322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 551/1111] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:23.413496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:23.413915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:23.414067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:23.420022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:23.432981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:23.434257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:23.501061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 561/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:23.525762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536efefc-a00c-49a2-a6cc-b7406cdbdd59 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:23.626650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536efefc-a00c-49a2-a6cc-b7406cdbdd59 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:23.660962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:23.662394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:23.662680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:23.662960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] PATH_INFO: `/v3/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:23.664470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] RBAC: Authorizing `identity:get_role(role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:23.665829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:23.667212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 552/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:23 2022] GET /identity/v3/roles/a35ac9e7d95640e99df8d5940692e128 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:23.672927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:23.772191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aabea-bb96-4810-8e6a-58e4bd09b55a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:23.806771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:23.807670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:23.807959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:23.808240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] PATH_INFO: `/v3/users/c8807b44348d4dc2ae924ef9979e965b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:23.810196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:23.823192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c8807b44348d4dc2ae924ef9979e965b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:23.824648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:23.826323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 562/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:23 2022] GET /identity/v3/users/c8807b44348d4dc2ae924ef9979e965b => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:23.832035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:23.861819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:23.933201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53db31-1956-40b2-b03f-88e5d6b9fa76 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:23.967954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:23.968599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:23.968885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:23.969163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:24.037313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:24.038889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:24.066332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:24.138513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 553/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:24.144369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:24.242747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96c763-cf98-4f0f-b3c9-6c4519c611a8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:24.277114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211b37b-4723-4296-b947-96e3e2163cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:24.277966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b37b-4723-4296-b947-96e3e2163cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:24.278252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b37b-4723-4296-b947-96e3e2163cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:24.278529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b37b-4723-4296-b947-96e3e2163cc5 None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:24.279746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211b37b-4723-4296-b947-96e3e2163cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b778d41a8548a0abbf8020dd1834d8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:24.281190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211b37b-4723-4296-b947-96e3e2163cc5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:24.282874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 563/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:24 2022] GET /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:24.289775 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:24.387102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af14b69-cb16-4fe3-9195-0ac5e44de077 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:24.413363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:24.423701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:24.424444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:24.424736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:24.425051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:24.425911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] RBAC: Adding query filter params (role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=f8b778d41a8548a0abbf8020dd1834d8, user.id=c8807b44348d4dc2ae924ef9979e965b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:24.426227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:24.428425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2f9f-55e2-43e0-98b7-95ef9b81c6e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:24.434364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 554/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:24 2022] GET /identity/v3/role_assignments?user.id=c8807b44348d4dc2ae924ef9979e965b&scope.project.id=f8b778d41a8548a0abbf8020dd1834d8&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:26.667831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881e8f-d639-4d5b-b98f-fbe59fc578fa None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:26.668367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881e8f-d639-4d5b-b98f-fbe59fc578fa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:26.668463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881e8f-d639-4d5b-b98f-fbe59fc578fa None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:26.669767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 564/1118] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:26.674971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:26.675453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:26.675559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:26.693388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:26.694564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:26.759345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 555/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:26.781197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881e8f-d639-4d5b-b98f-fbe59fc578fa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:26.840695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:26.881503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881e8f-d639-4d5b-b98f-fbe59fc578fa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:26.915605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:26.916447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:26.916734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:26.917013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] PATH_INFO: `/v3/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:26.918559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] RBAC: Authorizing `identity:get_role(role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:26.919906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:26.921279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 565/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:26 2022] GET /identity/v3/roles/a35ac9e7d95640e99df8d5940692e128 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:26.927829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:27.023640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01394-65f2-4d94-97e8-341eb02240b6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:27.046734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:27.059332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:27.060212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:27.060501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:27.060782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] PATH_INFO: `/v3/users/c8807b44348d4dc2ae924ef9979e965b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:27.061969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] RBAC: Authorizing `identity:get_user(user_id=c8807b44348d4dc2ae924ef9979e965b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:27.063434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:27.065069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 556/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:26 2022] GET /identity/v3/users/c8807b44348d4dc2ae924ef9979e965b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:27.070806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:27.169626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9747-c8e3-4972-90a4-329d6fbc558d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:27.196869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:27.205033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca922a9-1ff4-4b89-bc52-7afb4111dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:27.205909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca922a9-1ff4-4b89-bc52-7afb4111dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:27.206199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca922a9-1ff4-4b89-bc52-7afb4111dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:27.206481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca922a9-1ff4-4b89-bc52-7afb4111dd14 None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:27.207687 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca922a9-1ff4-4b89-bc52-7afb4111dd14 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b778d41a8548a0abbf8020dd1834d8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:27.209199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca922a9-1ff4-4b89-bc52-7afb4111dd14 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:27.210921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 566/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:27 2022] GET /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:27.216699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:27.321151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfd70-808d-4933-8551-4e5daf861835 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:27.355224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec725d6a-4e4c-43fd-965e-d76022ad5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:27.356111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725d6a-4e4c-43fd-965e-d76022ad5dcf None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:27.356395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725d6a-4e4c-43fd-965e-d76022ad5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:27.356672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725d6a-4e4c-43fd-965e-d76022ad5dcf None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8/users/c8807b44348d4dc2ae924ef9979e965b/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:27.358851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec725d6a-4e4c-43fd-965e-d76022ad5dcf None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b778d41a8548a0abbf8020dd1834d8, user_id=c8807b44348d4dc2ae924ef9979e965b, role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:27.360325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec725d6a-4e4c-43fd-965e-d76022ad5dcf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:27.375647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 557/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:56:27 2022] PUT /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8/users/c8807b44348d4dc2ae924ef9979e965b/roles/a35ac9e7d95640e99df8d5940692e128 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 14:56:29.637412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f383-e79b-48da-8bd3-96c77fbf764f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:29.637945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f383-e79b-48da-8bd3-96c77fbf764f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:29.638040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092f383-e79b-48da-8bd3-96c77fbf764f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:29.639467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 567/1124] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:29.644743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:29.645166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:29.645576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:29.663869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:29.665048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:29.712175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:29.734310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 558/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:29.759532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092f383-e79b-48da-8bd3-96c77fbf764f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:29.859438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092f383-e79b-48da-8bd3-96c77fbf764f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:29.892865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:29.893645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:29.893934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:29.894212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] PATH_INFO: `/v3/roles/a35ac9e7d95640e99df8d5940692e128` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:29.895715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] RBAC: Authorizing `identity:get_role(role_id=a35ac9e7d95640e99df8d5940692e128)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:29.897246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:29.898606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 568/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:29 2022] GET /identity/v3/roles/a35ac9e7d95640e99df8d5940692e128 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:29.904342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:30.006540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa29a1-3ca5-48d9-ade0-29519bedee7d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:30.048155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:30.049026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:30.049308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:30.049582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] PATH_INFO: `/v3/users/c8807b44348d4dc2ae924ef9979e965b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:30.050749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] RBAC: Authorizing `identity:get_user(user_id=c8807b44348d4dc2ae924ef9979e965b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:30.053237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:30.054864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 559/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:29 2022] GET /identity/v3/users/c8807b44348d4dc2ae924ef9979e965b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:30.060594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:30.121495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:30.158707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432346-520b-4c50-a166-14de310216a1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:30.192719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:30.193351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:30.193637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:30.193918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:30.259107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:30.260583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:30.325751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:30.367779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 569/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:30.373672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:30.424783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:30.475074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da662-3c4f-41c0-a1f1-ccd82d083b28 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:30.507596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0d65-a62f-4e76-9205-d521e75c8d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:30.508452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0d65-a62f-4e76-9205-d521e75c8d69 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:30.508736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0d65-a62f-4e76-9205-d521e75c8d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:30.509012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0d65-a62f-4e76-9205-d521e75c8d69 None admin] PATH_INFO: `/v3/projects/f8b778d41a8548a0abbf8020dd1834d8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:30.510171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d0d65-a62f-4e76-9205-d521e75c8d69 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b778d41a8548a0abbf8020dd1834d8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:30.511627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d0d65-a62f-4e76-9205-d521e75c8d69 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:30.513313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 560/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:30 2022] GET /identity/v3/projects/f8b778d41a8548a0abbf8020dd1834d8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:30.519313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:30.617362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ccbbb-d6df-489b-a437-d74261abbc0d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:30.651952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:30.652599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:30.652892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:30.653177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:30.654013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] RBAC: Adding query filter params (role.id=a35ac9e7d95640e99df8d5940692e128, scope.project.id=f8b778d41a8548a0abbf8020dd1834d8, user.id=c8807b44348d4dc2ae924ef9979e965b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:30.654331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:30.655812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce2f30-bd33-42fd-921d-c3641ba59a15 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:30.662560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 570/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:30 2022] GET /identity/v3/role_assignments?user.id=c8807b44348d4dc2ae924ef9979e965b&scope.project.id=f8b778d41a8548a0abbf8020dd1834d8&role.id=a35ac9e7d95640e99df8d5940692e128 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:32.919833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301315-da96-4246-a5c4-b55df09184f9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:32.920427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301315-da96-4246-a5c4-b55df09184f9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:32.920427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301315-da96-4246-a5c4-b55df09184f9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:32.921745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 561/1131] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:32.926919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:32.927332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:32.927537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:32.944527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:32.945708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:32.968514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:33.012564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 571/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:33.037673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0301315-da96-4246-a5c4-b55df09184f9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:33.139936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0301315-da96-4246-a5c4-b55df09184f9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:33.156996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:33.175163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0400-4c9a-424c-997b-b77b3958eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:33.175900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0400-4c9a-424c-997b-b77b3958eb6f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:33.176223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0400-4c9a-424c-997b-b77b3958eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:33.176536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0400-4c9a-424c-997b-b77b3958eb6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:33.177856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0400-4c9a-424c-997b-b77b3958eb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:33.179383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0400-4c9a-424c-997b-b77b3958eb6f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:33.181103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 562/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:33.186822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:33.285646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420531c-c740-4f40-8046-1a3217c6731b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:33.329963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41e95-8e07-4c69-8932-0b621b952aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:33.330627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41e95-8e07-4c69-8932-0b621b952aef None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:33.330919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41e95-8e07-4c69-8932-0b621b952aef None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:33.331236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41e95-8e07-4c69-8932-0b621b952aef None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:33.331944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41e95-8e07-4c69-8932-0b621b952aef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:33.333625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41e95-8e07-4c69-8932-0b621b952aef None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:33.359022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 572/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:56:33 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:35.581725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e19dd-9899-4233-90c8-abcd06a94532 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:35.582278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e19dd-9899-4233-90c8-abcd06a94532 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:35.582278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e19dd-9899-4233-90c8-abcd06a94532 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:35.584418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 563/1135] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:35.589616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:35.590038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:35.590182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:35.607312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:35.608498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:35.611200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:35.676460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 573/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:35.704728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e19dd-9899-4233-90c8-abcd06a94532 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:35.803931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e19dd-9899-4233-90c8-abcd06a94532 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:35.836892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd09a8-804d-4bf8-b976-07beb51e6b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:35.837606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd09a8-804d-4bf8-b976-07beb51e6b97 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:35.837885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd09a8-804d-4bf8-b976-07beb51e6b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:35.838157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd09a8-804d-4bf8-b976-07beb51e6b97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:35.839338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd09a8-804d-4bf8-b976-07beb51e6b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:35.840747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd09a8-804d-4bf8-b976-07beb51e6b97 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:35.842331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 564/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:35.847952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:35.945206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223eeb-4ffd-4048-b771-cddfc4693260 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:35.978435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee530d-ed6c-46e1-94b4-c119f127978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:35.979125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee530d-ed6c-46e1-94b4-c119f127978b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:35.979416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee530d-ed6c-46e1-94b4-c119f127978b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:35.979698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee530d-ed6c-46e1-94b4-c119f127978b None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:35.980399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee530d-ed6c-46e1-94b4-c119f127978b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:35.981845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee530d-ed6c-46e1-94b4-c119f127978b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:35.991399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:36.005051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 574/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:56:35 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:38.296160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653d5a4-d883-4247-9459-1514b7f03314 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:38.296686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653d5a4-d883-4247-9459-1514b7f03314 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:38.296781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653d5a4-d883-4247-9459-1514b7f03314 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:38.298118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 565/1139] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:38.303737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:38.304161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:38.304307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:38.321665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:38.322846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:38.388174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 575/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:38.411909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653d5a4-d883-4247-9459-1514b7f03314 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:38.466944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:38.514643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653d5a4-d883-4247-9459-1514b7f03314 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:38.548730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:38.549456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:38.549744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:38.550024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:38.560823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:38.568658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:38.569927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:38.571436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 566/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:38.575776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:38.674617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474c417-3d03-4093-9e03-3c0b755285f3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:38.701075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:38.710317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:38.710976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:38.711294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:38.711580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:38.712331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:38.712644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:38.714063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:38.722060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 576/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:38.729274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:38.830240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b100553-7b2a-427a-b457-b7e12a565a9b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:38.843555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:38.865504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:38.866365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:38.866688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:38.866967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] PATH_INFO: `/v3/users/2c218fce17094e83b1522356f1b4e28e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:38.879955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] RBAC: Authorizing `identity:get_user(user_id=2c218fce17094e83b1522356f1b4e28e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:38.881389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:38.883036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 567/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:38 2022] GET /identity/v3/users/2c218fce17094e83b1522356f1b4e28e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:38.888721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:38.987103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5042eb-3a6e-4e86-88b2-d01b341cdcdc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:39.019512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:39.020773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:39.021061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:39.021338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:39.075090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:39.088278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:39.089671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:39.184571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 577/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:39.190724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:39.290179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558a93-9232-4044-93eb-43784987ac8d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:39.323790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b052c5d-bd29-4735-be1f-5d9ec5f83b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:39.324641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052c5d-bd29-4735-be1f-5d9ec5f83b1f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:39.324928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052c5d-bd29-4735-be1f-5d9ec5f83b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:39.325204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052c5d-bd29-4735-be1f-5d9ec5f83b1f None admin] PATH_INFO: `/v3/projects/b2e0c3bf895942ddbeeba799272d298a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:39.326368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b052c5d-bd29-4735-be1f-5d9ec5f83b1f None admin] RBAC: Authorizing `identity:get_project(project_id=b2e0c3bf895942ddbeeba799272d298a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:39.327819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b052c5d-bd29-4735-be1f-5d9ec5f83b1f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:39.329501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 568/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:39 2022] GET /identity/v3/projects/b2e0c3bf895942ddbeeba799272d298a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:39.335606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:39.421573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:39.434176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f1303-3f03-422e-a8f1-33fe3ca012d1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:39.469147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:39.469796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:39.470087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:39.470371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:39.471235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=b2e0c3bf895942ddbeeba799272d298a, user.id=2c218fce17094e83b1522356f1b4e28e) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:39.471556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:39.473034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baff720-4f1b-4b1e-b3c1-bc64ad89872e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:39.478549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 578/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:39 2022] GET /identity/v3/role_assignments?user.id=2c218fce17094e83b1522356f1b4e28e&scope.project.id=b2e0c3bf895942ddbeeba799272d298a&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:41.636113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4e02a-bc98-4427-b8dc-a3f413c923c5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:41.636754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4e02a-bc98-4427-b8dc-a3f413c923c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:41.636754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4e02a-bc98-4427-b8dc-a3f413c923c5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:41.638036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 569/1147] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:41.643378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:41.643774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:41.643947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:41.662006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:41.663230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:41.729636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 579/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:41.753089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4e02a-bc98-4427-b8dc-a3f413c923c5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:41.796036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:41.857494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4e02a-bc98-4427-b8dc-a3f413c923c5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:41.891230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:41.892050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:41.892344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:41.892624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:41.903029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:41.911622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:41.912806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:41.913985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 570/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:41.918858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:41.999653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:42.018469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ff3f-ae80-4422-a60a-176a7414b2e4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:42.054461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:42.055177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:42.055469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:42.055751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:42.056500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:42.056810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:42.058207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:42.066140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 580/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:42.072562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:42.168529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:42.172415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277b201-4a59-44a3-9e46-fd149b88e08f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:42.206678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:42.208279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:42.208622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:42.208908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] PATH_INFO: `/v3/users/2c218fce17094e83b1522356f1b4e28e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:42.210108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] RBAC: Authorizing `identity:get_user(user_id=2c218fce17094e83b1522356f1b4e28e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:42.211588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:42.213228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 571/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:42 2022] GET /identity/v3/users/2c218fce17094e83b1522356f1b4e28e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:42.218951 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:42.316483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed8fd-92df-40db-baa2-e5c84be1778d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:42.349358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e09f43-272b-4f3c-9bf3-d115384bdeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:42.350200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09f43-272b-4f3c-9bf3-d115384bdeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:42.350487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09f43-272b-4f3c-9bf3-d115384bdeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:42.350763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09f43-272b-4f3c-9bf3-d115384bdeb0 None admin] PATH_INFO: `/v3/projects/b2e0c3bf895942ddbeeba799272d298a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:42.351966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e09f43-272b-4f3c-9bf3-d115384bdeb0 None admin] RBAC: Authorizing `identity:get_project(project_id=b2e0c3bf895942ddbeeba799272d298a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:42.353394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e09f43-272b-4f3c-9bf3-d115384bdeb0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:42.355074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 581/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:42 2022] GET /identity/v3/projects/b2e0c3bf895942ddbeeba799272d298a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:42.360983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:42.461455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11ddb-fef8-46d0-b9f9-335d273f41f2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:42.494643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae79661-79e0-4903-99b7-3b9bf2b4b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:42.495550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79661-79e0-4903-99b7-3b9bf2b4b0aa None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:42.495840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79661-79e0-4903-99b7-3b9bf2b4b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:42.496119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79661-79e0-4903-99b7-3b9bf2b4b0aa None admin] PATH_INFO: `/v3/projects/b2e0c3bf895942ddbeeba799272d298a/users/2c218fce17094e83b1522356f1b4e28e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:42.498063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae79661-79e0-4903-99b7-3b9bf2b4b0aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b2e0c3bf895942ddbeeba799272d298a, user_id=2c218fce17094e83b1522356f1b4e28e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:42.499528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae79661-79e0-4903-99b7-3b9bf2b4b0aa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:42.513628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 572/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:56:42 2022] PUT /identity/v3/projects/b2e0c3bf895942ddbeeba799272d298a/users/2c218fce17094e83b1522356f1b4e28e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:56:44.702535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c577-517d-46ba-b652-11ed7c442f5e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:44.703123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c577-517d-46ba-b652-11ed7c442f5e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:44.703123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c577-517d-46ba-b652-11ed7c442f5e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:44.704493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 582/1154] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:44.710496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:44.710917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:44.711066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:44.728182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:44.729357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:44.750868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:44.800271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 573/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:44.822843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8c577-517d-46ba-b652-11ed7c442f5e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:44.838707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:44.923606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8c577-517d-46ba-b652-11ed7c442f5e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:44.956156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:44.956874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:44.957159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:44.958003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:44.967940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:44.975855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:44.976939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:44.977842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 583/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:44.982870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:45.080326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fcc39-c2c5-4122-bd59-433559a9df2e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:45.113381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:45.114113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:45.114464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:45.114743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:45.115519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:45.115828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:45.117189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:45.124993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 574/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:45.131496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:45.200335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:45.230312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb347-5a47-44a4-96cb-ed09a3fbd5ab None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:45.263182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:45.264066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:45.264359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:45.264641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] PATH_INFO: `/v3/users/2c218fce17094e83b1522356f1b4e28e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:45.265824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] RBAC: Authorizing `identity:get_user(user_id=2c218fce17094e83b1522356f1b4e28e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:45.267331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:45.268955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 584/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:45 2022] GET /identity/v3/users/2c218fce17094e83b1522356f1b4e28e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:45.275526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:45.294765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:45.374409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f4150-3faf-4727-b279-f853adb33919 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:45.406938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:45.407608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:45.407894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:45.408435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:45.473777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:45.475244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:45.492858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:45.578021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 575/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:45.584524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:45.683901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e59b-9ef6-4195-a62d-8f2a459c797c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:45.716545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3575206-1207-4d43-ac5c-d35089bdd121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:45.717390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3575206-1207-4d43-ac5c-d35089bdd121 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:45.717671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3575206-1207-4d43-ac5c-d35089bdd121 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:45.717947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3575206-1207-4d43-ac5c-d35089bdd121 None admin] PATH_INFO: `/v3/projects/b2e0c3bf895942ddbeeba799272d298a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:45.719122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3575206-1207-4d43-ac5c-d35089bdd121 None admin] RBAC: Authorizing `identity:get_project(project_id=b2e0c3bf895942ddbeeba799272d298a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:45.720558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3575206-1207-4d43-ac5c-d35089bdd121 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:45.722217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 585/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:45 2022] GET /identity/v3/projects/b2e0c3bf895942ddbeeba799272d298a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:45.728652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:45.828002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc16e-e2e0-434c-838b-80c25443a471 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:45.844604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:45.874418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:45.875065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:45.876624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:45.876904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:45.877730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=b2e0c3bf895942ddbeeba799272d298a, user.id=2c218fce17094e83b1522356f1b4e28e) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:45.878043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:45.879600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc61c0-9d7a-49a2-9f19-45c7d37a001e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:45.885518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 576/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:45 2022] GET /identity/v3/role_assignments?user.id=2c218fce17094e83b1522356f1b4e28e&scope.project.id=b2e0c3bf895942ddbeeba799272d298a&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:48.108087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012443-c7b2-48e0-93bf-c53b3208dc58 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:48.108593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012443-c7b2-48e0-93bf-c53b3208dc58 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:48.108710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012443-c7b2-48e0-93bf-c53b3208dc58 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:48.110101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 586/1162] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:48.115457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:48.115866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:48.116011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:48.132888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:48.134057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:48.199518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 577/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:48.229092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012443-c7b2-48e0-93bf-c53b3208dc58 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:48.240481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:48.332012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012443-c7b2-48e0-93bf-c53b3208dc58 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:48.366398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48f25-d103-45d9-807a-511216357aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:48.367034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48f25-d103-45d9-807a-511216357aff None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:48.367357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48f25-d103-45d9-807a-511216357aff None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:48.367632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48f25-d103-45d9-807a-511216357aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:48.433125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf48f25-d103-45d9-807a-511216357aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:48.434564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf48f25-d103-45d9-807a-511216357aff None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:48.444427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:48.530858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 587/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:48.537696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:48.637379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829bd34-735b-4459-b4cf-e903d4db0ba3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:48.650053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:48.672055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:48.672848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:48.673135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:48.673415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:48.680767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:48.682208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c374c79c-6e6f-4b48-bac2-be0553fc73ce None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:48.696349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:48.697571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:56:48.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 578/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:56:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:48.703491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48f25-d103-45d9-807a-511216357aff None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:48.800515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48f25-d103-45d9-807a-511216357aff None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:48.810401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:48.834971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:48.835649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:48.835933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:48.836207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:48.836921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:48.837224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:48.838587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab815a-f26c-49e3-a550-0306d6ef767b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:48.845574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 588/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Thu May 26 14:56:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:51.030174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc537b-595c-4cf2-a806-7fbf3def6ef7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:51.030698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc537b-595c-4cf2-a806-7fbf3def6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:51.030813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc537b-595c-4cf2-a806-7fbf3def6ef7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:51.032166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 579/1167] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:51.037923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f483-965c-4e67-a7d0-ed58588a94fa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:51.038361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f483-965c-4e67-a7d0-ed58588a94fa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:51.038492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f483-965c-4e67-a7d0-ed58588a94fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:51.055379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-56b8f483-965c-4e67-a7d0-ed58588a94fa None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:51.056577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-56b8f483-965c-4e67-a7d0-ed58588a94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:51.123016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 589/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:51.146915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc537b-595c-4cf2-a806-7fbf3def6ef7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:51.252841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc537b-595c-4cf2-a806-7fbf3def6ef7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:51.286510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bd4cd-5beb-4a93-ac88-7b073f0dc9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:51.287122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bd4cd-5beb-4a93-ac88-7b073f0dc9d3 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:51.287418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bd4cd-5beb-4a93-ac88-7b073f0dc9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:51.287698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bd4cd-5beb-4a93-ac88-7b073f0dc9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:51.288437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bd4cd-5beb-4a93-ac88-7b073f0dc9d3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:51.289800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bd4cd-5beb-4a93-ac88-7b073f0dc9d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:51.304871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 580/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Thu May 26 14:56:51 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:53.527344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224d1d6-dbc1-4c1f-b42c-226f911b57ce None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:53.527883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224d1d6-dbc1-4c1f-b42c-226f911b57ce None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:53.527984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224d1d6-dbc1-4c1f-b42c-226f911b57ce None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:53.529293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 590/1170] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:53.534818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:53.535243 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:53.535402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:53.552470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:53.553642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:53.579219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:53.620374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 581/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:53.643695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224d1d6-dbc1-4c1f-b42c-226f911b57ce None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:53.744828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224d1d6-dbc1-4c1f-b42c-226f911b57ce None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:53.746367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:53.780071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1521de-cbbd-4c23-813f-7f7198e27e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:53.780859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1521de-cbbd-4c23-813f-7f7198e27e7c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:53.781149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1521de-cbbd-4c23-813f-7f7198e27e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:53.781433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1521de-cbbd-4c23-813f-7f7198e27e7c None admin] PATH_INFO: `/v3/domains/4bd40b715757423a8e162ba7ac272057` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:53.791886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1521de-cbbd-4c23-813f-7f7198e27e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=4bd40b715757423a8e162ba7ac272057)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:53.793348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1521de-cbbd-4c23-813f-7f7198e27e7c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:53.794980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 591/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Thu May 26 14:56:53 2022] GET /identity/v3/domains/4bd40b715757423a8e162ba7ac272057 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:53.801327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:53.897143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c90b5-9924-4224-a7c3-47ee38773c3d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:53.931520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223a2ba-71be-4077-9364-79cdda9a75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:53.932169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223a2ba-71be-4077-9364-79cdda9a75ba None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:53.932458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223a2ba-71be-4077-9364-79cdda9a75ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:53.932739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223a2ba-71be-4077-9364-79cdda9a75ba None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:53.933447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223a2ba-71be-4077-9364-79cdda9a75ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:53.934869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223a2ba-71be-4077-9364-79cdda9a75ba None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:53.959142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 582/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:56:53 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:56:56.178114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823ba8-a3cf-461e-b94a-e663d4742555 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:56.178630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823ba8-a3cf-461e-b94a-e663d4742555 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:56.178719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823ba8-a3cf-461e-b94a-e663d4742555 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:56.180094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 592/1174] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:56.185561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:56.186038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:56.186130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:56.202581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:56.203793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:56.213057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:56.270414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 583/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:56:56.295507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823ba8-a3cf-461e-b94a-e663d4742555 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:56.399472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823ba8-a3cf-461e-b94a-e663d4742555 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:56.434974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49508-3cf3-477b-9bcb-08ecdad82e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:56.435861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49508-3cf3-477b-9bcb-08ecdad82e4d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:56.436150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49508-3cf3-477b-9bcb-08ecdad82e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:56.436428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49508-3cf3-477b-9bcb-08ecdad82e4d None admin] PATH_INFO: `/v3/domains/4bd40b715757423a8e162ba7ac272057` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:56.437611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49508-3cf3-477b-9bcb-08ecdad82e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=4bd40b715757423a8e162ba7ac272057)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:56.439049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49508-3cf3-477b-9bcb-08ecdad82e4d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:56.440699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 593/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Thu May 26 14:56:56 2022] GET /identity/v3/domains/4bd40b715757423a8e162ba7ac272057 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:56.447021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:56.545852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd26407-26b8-41a6-ae46-0f2ed459fc08 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:56.579748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fb92f-a881-4bb5-8a91-7fd2a812da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:56.580401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb92f-a881-4bb5-8a91-7fd2a812da1d None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:56.580681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb92f-a881-4bb5-8a91-7fd2a812da1d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:56.580954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb92f-a881-4bb5-8a91-7fd2a812da1d None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:56.581656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fb92f-a881-4bb5-8a91-7fd2a812da1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:56.584117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fb92f-a881-4bb5-8a91-7fd2a812da1d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:56.599940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:56.610965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 584/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:56:56 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:56:58.840621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9312aa-cc3f-440c-ae6a-f454cd86cce7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:58.841188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9312aa-cc3f-440c-ae6a-f454cd86cce7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:58.841188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9312aa-cc3f-440c-ae6a-f454cd86cce7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:58.842562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 594/1178] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:56:58.848053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:58.848495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:58.848705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:58.865698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:56:58.866877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:56:58.932301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 585/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:56:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 14:56:58.956212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9312aa-cc3f-440c-ae6a-f454cd86cce7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:58.986348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:59.058440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9312aa-cc3f-440c-ae6a-f454cd86cce7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:59.092515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:59.093240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:59.093531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:59.093815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:59.103877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:56:59.111572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:56:59.112667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:56:59.114365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 595/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:56:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:56:59.119506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:59.217530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8f78c-a6f1-45fb-801a-fc892a2f8c35 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:59.246098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:59.252026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:59.252683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:59.252967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:59.253248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:59.254029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:56:59.254479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:59.255693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:59.263694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 586/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:56:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:59.269383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:59.361881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:59.372374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c415faa-0a11-47a4-93a9-36931be0fbd7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:59.405205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:59.406055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:59.406337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:59.406612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] PATH_INFO: `/v3/users/abf707e264664e398bcbb7d8ab85978f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:59.421381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] RBAC: Authorizing `identity:get_user(user_id=abf707e264664e398bcbb7d8ab85978f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:59.422814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:59.424481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 596/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:56:59 2022] GET /identity/v3/users/abf707e264664e398bcbb7d8ab85978f => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:59.431376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:59.528593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96977761-979e-492b-a7c4-e95ad5c600e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:59.561531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:59.562165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:59.562449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:59.562728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:59.618836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:59.628403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:59.629876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:59.725724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 587/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:56:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:56:59.731539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:59.829452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457017-c631-4bb0-9c65-4e012cd1ee21 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:56:59.862395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6d83-734c-44b4-91ba-a361de4c74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:56:59.863812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6d83-734c-44b4-91ba-a361de4c74e9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:56:59.864097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6d83-734c-44b4-91ba-a361de4c74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:56:59.864375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6d83-734c-44b4-91ba-a361de4c74e9 None admin] PATH_INFO: `/v3/projects/3acc804355434e4fb5f17fdbd83a2295` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:56:59.865558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6d83-734c-44b4-91ba-a361de4c74e9 None admin] RBAC: Authorizing `identity:get_project(project_id=3acc804355434e4fb5f17fdbd83a2295)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:56:59.867005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6d83-734c-44b4-91ba-a361de4c74e9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:56:59.868721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 597/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:56:59 2022] GET /identity/v3/projects/3acc804355434e4fb5f17fdbd83a2295 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:56:59.874667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:56:59.962687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:56:59.971901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065dc81-360c-4916-ab2e-ad6e233e14d4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:00.005919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:00.006566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:00.006856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:00.007163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:00.007991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=3acc804355434e4fb5f17fdbd83a2295, user.id=abf707e264664e398bcbb7d8ab85978f) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:57:00.008308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:00.009736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f3e77-0dc3-4242-be75-80418b19ea96 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:00.015290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 588/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:56:59 2022] GET /identity/v3/role_assignments?user.id=abf707e264664e398bcbb7d8ab85978f&scope.project.id=3acc804355434e4fb5f17fdbd83a2295&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:02.223047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e23ae-b3c1-4df2-86c4-d2d5a6fa476d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:02.223606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e23ae-b3c1-4df2-86c4-d2d5a6fa476d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:02.223761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e23ae-b3c1-4df2-86c4-d2d5a6fa476d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:02.225140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 598/1186] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:57:02.230310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:02.230724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:02.230875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:02.248703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:57:02.249890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:57:02.315640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 589/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:57:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:57:02.337692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e23ae-b3c1-4df2-86c4-d2d5a6fa476d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:02.356268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:02.447263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e23ae-b3c1-4df2-86c4-d2d5a6fa476d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:02.480194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:02.480983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:02.481271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:02.481553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:02.492024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:57:02.499690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:57:02.500787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:57:02.501821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 599/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:57:02.507258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:02.589654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:02.604908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb9f3-add1-4015-bf41-97309b8d8c51 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:02.637469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:02.638125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:02.638414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:02.638694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:02.639467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:57:02.639778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:02.641140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:02.649605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 590/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:57:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:02.655361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:02.732302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:02.755600 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027047b3-a3b9-4481-93aa-4d047a1f77b7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:02.789334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:02.790206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:02.790496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:02.790778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] PATH_INFO: `/v3/users/abf707e264664e398bcbb7d8ab85978f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:02.791994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=abf707e264664e398bcbb7d8ab85978f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:02.793452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:02.795098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 600/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:57:02 2022] GET /identity/v3/users/abf707e264664e398bcbb7d8ab85978f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:02.801293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:02.900557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2f5fc-ecec-43ec-bb2b-15940cd41f50 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:02.933708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b79fe5-ec28-4f73-95d6-5b3a2a292290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:02.934551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79fe5-ec28-4f73-95d6-5b3a2a292290 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:02.934828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79fe5-ec28-4f73-95d6-5b3a2a292290 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:02.935120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79fe5-ec28-4f73-95d6-5b3a2a292290 None admin] PATH_INFO: `/v3/projects/3acc804355434e4fb5f17fdbd83a2295` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:02.936275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b79fe5-ec28-4f73-95d6-5b3a2a292290 None admin] RBAC: Authorizing `identity:get_project(project_id=3acc804355434e4fb5f17fdbd83a2295)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:02.937682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b79fe5-ec28-4f73-95d6-5b3a2a292290 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:02.939374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 591/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:57:02 2022] GET /identity/v3/projects/3acc804355434e4fb5f17fdbd83a2295 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:02.945691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:03.045706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e8d0-6222-4b7d-8061-ade9dc7cd4c2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:03.079263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad641-dc42-41c0-ad52-089a7cd69d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:03.080137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad641-dc42-41c0-ad52-089a7cd69d4a None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:03.080427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad641-dc42-41c0-ad52-089a7cd69d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:03.080708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad641-dc42-41c0-ad52-089a7cd69d4a None admin] PATH_INFO: `/v3/projects/3acc804355434e4fb5f17fdbd83a2295/users/abf707e264664e398bcbb7d8ab85978f/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:03.083258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad641-dc42-41c0-ad52-089a7cd69d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=3acc804355434e4fb5f17fdbd83a2295, user_id=abf707e264664e398bcbb7d8ab85978f, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:03.084708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad641-dc42-41c0-ad52-089a7cd69d4a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:03.097279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 601/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:57:02 2022] PUT /identity/v3/projects/3acc804355434e4fb5f17fdbd83a2295/users/abf707e264664e398bcbb7d8ab85978f/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:57:05.310376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062913-bca9-4995-82e8-8d33e0b634d1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:05.310897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062913-bca9-4995-82e8-8d33e0b634d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:05.310897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062913-bca9-4995-82e8-8d33e0b634d1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:05.312278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 592/1193] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:57:05.318074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:05.318501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:05.318646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:05.324617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:05.336775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:57:05.337963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:57:05.404078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 602/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:57:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:57:05.427733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87062913-bca9-4995-82e8-8d33e0b634d1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:05.446623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:05.530208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87062913-bca9-4995-82e8-8d33e0b634d1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:05.564055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:05.564781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:05.565069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:05.565348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:05.576012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:57:05.583740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:57:05.584873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:57:05.585945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 593/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:57:05.590998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:05.689392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8baa-a1b7-4432-8e84-cae1f6996e1d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:05.723500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:05.724163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:05.724453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:05.724735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:05.725486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:57:05.725798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:05.727206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:05.728542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:05.736143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 603/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:05.742563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:05.820020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:05.842632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350ba5-313a-4aa7-9dc4-2757d30b35e1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:05.875139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:05.876001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:05.876283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:05.876558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] PATH_INFO: `/v3/users/abf707e264664e398bcbb7d8ab85978f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:05.877720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=abf707e264664e398bcbb7d8ab85978f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:05.879847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:05.881459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 594/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu May 26 14:57:05 2022] GET /identity/v3/users/abf707e264664e398bcbb7d8ab85978f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:05.887118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:05.984479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083d150-441b-4e26-87e3-8b55522cc24b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:06.017150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1736b-0385-487a-81db-e7737929facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:06.017788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1736b-0385-487a-81db-e7737929facb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:06.018076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1736b-0385-487a-81db-e7737929facb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:06.018357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1736b-0385-487a-81db-e7737929facb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:06.080029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:06.087054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1736b-0385-487a-81db-e7737929facb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:06.088559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1736b-0385-487a-81db-e7737929facb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:06.185301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 604/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:57:06.191196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:06.296767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e0340-5829-4583-8ded-31bcc26af3a6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:06.332952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44f936-d3c8-4b0f-b2df-e5cfe35b625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:06.333797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f936-d3c8-4b0f-b2df-e5cfe35b625a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:06.334082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f936-d3c8-4b0f-b2df-e5cfe35b625a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:06.334363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f936-d3c8-4b0f-b2df-e5cfe35b625a None admin] PATH_INFO: `/v3/projects/3acc804355434e4fb5f17fdbd83a2295` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:06.335569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44f936-d3c8-4b0f-b2df-e5cfe35b625a None admin] RBAC: Authorizing `identity:get_project(project_id=3acc804355434e4fb5f17fdbd83a2295)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:06.337012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44f936-d3c8-4b0f-b2df-e5cfe35b625a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:06.338727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 595/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu May 26 14:57:06 2022] GET /identity/v3/projects/3acc804355434e4fb5f17fdbd83a2295 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:06.344869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1736b-0385-487a-81db-e7737929facb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:57:06.438675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:06.444862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1736b-0385-487a-81db-e7737929facb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:57:06.480634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:57:06.481292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:57:06.481582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:57:06.481865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:57:06.482701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=3acc804355434e4fb5f17fdbd83a2295, user.id=abf707e264664e398bcbb7d8ab85978f) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:57:06.483018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:57:06.484504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fbe6f-423f-4652-84d0-13687464b2b4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:57:06.494943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 605/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:57:06 2022] GET /identity/v3/role_assignments?user.id=abf707e264664e398bcbb7d8ab85978f&scope.project.id=3acc804355434e4fb5f17fdbd83a2295&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:57:16.328233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:57:16.487781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=20 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:07.110904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b45e45-1787-47d8-baaf-beb1b449e458 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:07.112210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b45e45-1787-47d8-baaf-beb1b449e458 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:07.112210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b45e45-1787-47d8-baaf-beb1b449e458 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:07.113636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 596/1201] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:07.119541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:07.120397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:07.120899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:07.140749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:07.142823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:07.246511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 606/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:07.284546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b45e45-1787-47d8-baaf-beb1b449e458 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:07.430134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b45e45-1787-47d8-baaf-beb1b449e458 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:07.475306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:07.476300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:07.476676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:07.476976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:07.491062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:07.492563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:07.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:07.515277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:07.516275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:07.516275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:07.516275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:07.516275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:07.516275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 597/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:07.522530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:07.677320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346085bb-873f-485d-80ee-016a6c63a4a8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:07.714377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:07.723800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:07.724516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:07.724803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:07.725074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:07.725804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:07.726110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:07.727598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308da53-8872-4c5c-bb92-ef94b7c38174 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:07.743134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 607/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:07.748189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:07.819266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:07.879157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e6642-0fda-4be1-9568-9a43326c1b7e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:07.918814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6758e-3229-40eb-9bd8-0a50c3a19e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:07.919598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6758e-3229-40eb-9bd8-0a50c3a19e14 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:07.919884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6758e-3229-40eb-9bd8-0a50c3a19e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:07.920161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6758e-3229-40eb-9bd8-0a50c3a19e14 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:07.920877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6758e-3229-40eb-9bd8-0a50c3a19e14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:07.922454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6758e-3229-40eb-9bd8-0a50c3a19e14 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:07.952566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 598/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Thu May 26 14:58:07 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:58:10.381576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69528aab-9841-4fef-afc7-8102c8b2cca4 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:10.382144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69528aab-9841-4fef-afc7-8102c8b2cca4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:10.382144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69528aab-9841-4fef-afc7-8102c8b2cca4 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:10.383530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 608/1206] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:10.390148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:10.390701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:10.390701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:10.411229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:10.412464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:10.493002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 599/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:10.520341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69528aab-9841-4fef-afc7-8102c8b2cca4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:10.649098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69528aab-9841-4fef-afc7-8102c8b2cca4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:10.688964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:10.690808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:10.691081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:10.691398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:10.702138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:58:10.711388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:10.712470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:10.721881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 609/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:10.722815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:10.768158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:10.849248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15314fe-08db-4e57-9a3d-6165df2adb6b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:10.895666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:10.896451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:10.896859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:10.897230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:10.898121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:10.898507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:10.900339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:10.910809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 600/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:58:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:10.917055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:10.975954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:11.036241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe876a24-012e-459a-b608-ff1d7c8346bb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:11.073910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:11.074721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:11.075011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:11.075343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:11.089392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:11.091075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:11.110967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:11.112249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:11.113728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:11.113728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:11.113728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:11.113728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:11.113728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 610/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:11.118093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:11.235368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:11.240012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e376bd4-2ceb-45a0-8edb-05b294bfa961 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:11.292303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:11.292995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:11.293278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:11.293555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:11.294335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:11.294725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:11.296219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:11.310919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 601/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:11.316981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:11.444230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5b7c-9cba-4651-bbba-d142c8370c20 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:11.446099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:11.486831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:11.487708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:11.488031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:11.488316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:11.498045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:11.499769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:58:11.518978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:11.520099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:11.521210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 611/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:11.526197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:11.655979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f89fd5-715b-4612-8de1-4055c38b8716 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:11.701281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:11.701966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:11.702249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:11.702535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:11.703491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:11.703802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:11.706061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:11.725107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 602/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 14:58:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:58:11.731046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:11.851489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6c18f-5e4b-45ba-98b0-aac4eca690d4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:11.887840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:11.888672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:11.888909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:11.889195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:11.928138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:11.975295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:11.977074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:12.098207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 612/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:58:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 14:58:12.099594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:12.125873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:12.227671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c90e03-d356-4879-86e5-285188f58aa9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:12.264341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:12.265181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:12.265464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:12.265734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:12.277480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:12.279349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:12.298043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:12.301018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:12.301923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:12.301923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:12.301923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:12.301923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:12.301923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 603/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:12.305560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:12.370668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:12.415006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d021c-e025-4a67-ad20-fc887a1d7c9a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:12.453715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:12.454382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:12.454595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:12.455706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:12.456597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:12.456911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:12.458437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:12.472074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 613/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:12.477731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:12.560100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:12.598630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe2fc5-30f1-4a43-8591-48c606bffa06 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:12.634780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:12.635609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:12.635897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:12.636172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:12.644672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:12.646133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:58:12.661138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:12.662098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:12.663030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:12.667188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 604/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:12.668418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:12.779945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc481a5-73b3-4b81-a5ca-55dc4b90c54d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:12.817462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:12.833327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:12.834359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:12.834712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:12.834964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:12.835906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:12.836297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:12.837808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd84321-dcce-4b38-a35d-061b4a2100ff None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:12.851284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 614/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:12.857449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:12.984463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8da3b-8e14-4a1a-8954-3dccf2eccd45 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:13.022156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:13.046188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:13.046976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:13.047354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:13.047713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:13.049192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=5581ec9275db47fa96f784326ec51e99) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:13.049748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:13.051404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861ef36-474b-4ddc-8749-33ccdfabdf29 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:13.058642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 605/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:58:12 2022] GET /identity/v3/role_assignments?user.id=5581ec9275db47fa96f784326ec51e99&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:15.317525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458aee-c32d-4138-860f-abb187bd72fb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:15.318049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458aee-c32d-4138-860f-abb187bd72fb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:15.318049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458aee-c32d-4138-860f-abb187bd72fb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:15.319411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 615/1220] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:15.324990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:15.325520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:15.325602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:15.343278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:15.344477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:15.420226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 606/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:15.444152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1458aee-c32d-4138-860f-abb187bd72fb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:15.565364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1458aee-c32d-4138-860f-abb187bd72fb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:15.610248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:15.611197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:15.611627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:15.612017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:15.624513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:58:15.634674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:15.635806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:15.636637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 616/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:15.643849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:15.767975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934a76-66e2-4ed9-a579-df255d69e446 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:15.792396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:15.804686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:15.805349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:15.805623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:15.805926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:15.806721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:15.806955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:15.808345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:15.819378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 607/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:58:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:15.826423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:15.871362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:15.941188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2276-6a37-49a9-8b0b-306171207fa4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:15.979684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:15.980488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:15.980781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:15.981063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:15.995269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:15.995575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:16.013426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:16.014847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:16.016188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:16.016188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:16.016188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:16.016188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:16.016188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 617/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:16.022025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:16.133852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53908-357a-4954-a4c7-67b695c033f2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:16.175239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:16.175946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:16.176220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:16.176618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:16.177516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:16.177909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:16.179481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:16.192422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 608/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:16.199773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:16.309462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:16.317695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c192cd0-d609-4fb8-8ac5-b5d6d03c5ffc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:16.354748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:16.355616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:16.355905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:16.356189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:16.366699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:16.368302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:58:16.384434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:16.385868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:16.387263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 618/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:16.393035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:16.450225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:16.517651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59dd20-e419-4975-97ab-cb94d92d60f8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:16.555123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:16.555800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:16.556097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:16.556360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:16.557220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:16.557529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:16.558987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:16.576646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 609/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 14:58:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:16.582477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:16.690369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be938-88d7-4333-afb9-b02b75c9f544 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:16.727711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:16.728508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:16.728822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:16.729071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:16.740347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:16.741907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:16.761528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:16.762509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:16.763502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:16.763502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:16.763502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:16.763502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:16.763502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 619/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:16.769252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:16.879323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207e7a-7a20-490c-bc94-84edfcc03530 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:16.881749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:16.915025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:16.915731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:16.916023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:16.916304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:16.917034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:16.917343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:16.918715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:16.930833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 610/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:16.936562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:16.946729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:17.047264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360faac8-5021-4784-a703-57b5ee5c6cbb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:17.083809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:17.084728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:17.085060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:17.085399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:17.094286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:17.096584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:58:17.112431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:17.113436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:17.114312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 620/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:17.119721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:17.237458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4de5d-1d53-4c4c-a4f8-7653b353e8c0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:17.275272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:17.275960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:17.276250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:17.276562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:17.277460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:17.277806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:17.279441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838160e-ae40-4642-86c6-51a2c1c529e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:17.292908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 611/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:17.299064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:17.375208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:17.416317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5da71-14e8-4aca-9013-3eb53a63e0f9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:17.451821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba674-7890-4f28-81c8-c59c5eadee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:17.452712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba674-7890-4f28-81c8-c59c5eadee09 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:17.452994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba674-7890-4f28-81c8-c59c5eadee09 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:17.453266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba674-7890-4f28-81c8-c59c5eadee09 None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/5581ec9275db47fa96f784326ec51e99/roles/d9ec2e16b01a4dcd991442b0c52958bf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:17.469511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba674-7890-4f28-81c8-c59c5eadee09 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=5581ec9275db47fa96f784326ec51e99, role_id=d9ec2e16b01a4dcd991442b0c52958bf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:17.471764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba674-7890-4f28-81c8-c59c5eadee09 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:17.486063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 621/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:58:17 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/5581ec9275db47fa96f784326ec51e99/roles/d9ec2e16b01a4dcd991442b0c52958bf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:58:19.938935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe04c3a-4406-4a2d-97c4-bffbc6028e84 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:19.940328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe04c3a-4406-4a2d-97c4-bffbc6028e84 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:19.940328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe04c3a-4406-4a2d-97c4-bffbc6028e84 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:19.941631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 612/1233] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:19.947033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:19.947531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:19.947781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:19.966178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:19.967425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:20.042018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 622/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:20.066649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe04c3a-4406-4a2d-97c4-bffbc6028e84 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:20.093706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:20.177322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe04c3a-4406-4a2d-97c4-bffbc6028e84 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:20.216809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:20.217692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:20.218141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:20.218430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:20.233896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:58:20.243646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:20.244959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:20.245962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 613/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Thu May 26 14:58:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:20.253804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:20.306707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:20.367230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d08064-c218-410a-b154-0cd9b0f6706d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:20.405657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:20.406410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:20.407003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:20.407350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:20.408797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:20.409108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:20.410622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:20.420868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 623/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Thu May 26 14:58:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:20.428241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:20.529711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:20.548314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391428b-2b40-4334-9d04-1d2079333b8e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:20.588025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:20.588880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:20.589170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:20.589490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:20.601968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:20.603652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:20.623925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:20.625388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:20.626341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:20.626341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:20.626341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:20.626341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:20.626341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 614/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:20.631652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:20.749800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069081f-ed14-4e09-8251-08058c2b1b9f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:20.762779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:20.798321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:20.799252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:20.799641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:20.800046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:20.801063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:20.801528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:20.803701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:20.819229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 624/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:20.824912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:20.940531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd008-3293-489e-a5ae-4771f4a7225d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:20.978483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:20.979340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:20.979622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:20.979922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:20.982761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:20.988914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:20.990599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:58:21.006578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:21.008185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:21.009408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 615/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:21.014523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:21.132597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fefcd-3dff-40f4-884d-8a5e31a1e6a7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:21.170183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:21.170856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:21.171173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:21.171453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:21.172301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:21.172607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:21.174611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:21.200155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 625/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 14:58:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:21.200346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:21.318680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc50325-b1cd-4302-b730-128fcbd2c5a6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:21.361735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:21.362748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:21.363040 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:21.363497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:21.433352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:21.441127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:21.442702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:21.557034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 616/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:58:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 14:58:21.563303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:21.593859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:21.672681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841901c-32fa-46ff-a98a-98ac03784e11 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:21.713186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:21.714006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:21.714278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:21.714575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:21.726667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:21.728438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:21.749216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:21.750364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:21.751394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:21.751394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:21.751394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:21.751394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:21.751394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 626/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:21.756729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:21.870964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:21.876970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd929-ca4b-472b-93ed-a24a135bc415 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:21.913098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:21.913784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:21.914091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:21.914346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:21.915102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:21.915448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:21.916787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:21.929580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 617/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:21.935154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:22.040319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:22.067888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe7c6-7c56-4364-9d76-9c06eae996eb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:22.113681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:22.114595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:22.114885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:22.115214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:22.122626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:22.124279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:58:22.141569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:22.143258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:22.144161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 627/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:22.149478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:22.261581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce65db-e81f-4871-a4e9-264dfe82517b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:22.302093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:22.302690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:22.303054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:22.303357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:22.304255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:22.304613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:22.306302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9e32-4971-4d2b-9f7f-05235bce791c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:22.320426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 618/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:22.326496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:22.437098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744441-17fd-4886-bfbe-69927f908958 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:22.476059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:22.476734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:22.477028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:22.477313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:22.478154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] RBAC: Adding query filter params (role.id=d9ec2e16b01a4dcd991442b0c52958bf, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=5581ec9275db47fa96f784326ec51e99) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:22.478469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:22.479975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a264e56-ae2c-404b-b78f-39cd6017497f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:22.486051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 628/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:58:22 2022] GET /identity/v3/role_assignments?user.id=5581ec9275db47fa96f784326ec51e99&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=d9ec2e16b01a4dcd991442b0c52958bf => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:24.861094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c29934-3033-4204-868e-717de9b99c50 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:24.861905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c29934-3033-4204-868e-717de9b99c50 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:24.861905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c29934-3033-4204-868e-717de9b99c50 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:24.863203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 619/1247] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:24.869711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:24.870300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:24.870300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:24.875661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:24.890974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:24.893060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:24.972302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 629/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:24.998494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c29934-3033-4204-868e-717de9b99c50 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:25.020607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:25.122357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c29934-3033-4204-868e-717de9b99c50 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:25.160034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:25.161203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:25.161596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:25.161862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:25.173792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:58:25.182654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:25.183998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:25.185023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 620/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:25.191162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:25.308553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149b1f0-5c63-42db-85be-0bcb55aecff9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:25.337998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:25.344830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:25.345978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:25.346246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:25.346566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:25.347471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:25.347844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:25.349337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:25.364049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 630/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 14:58:25.365555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:25.457548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:25.484666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676833de-9b79-4bf1-88a6-7f21d62b100d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:25.523700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:25.524500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:25.524784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:25.525113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:25.536880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:25.538327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:25.558109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:25.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:25.560227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:25.560227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:25.560227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:25.560227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:25.560227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 621/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:25.565410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:25.686222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89a01-acad-408c-9403-32f083acc518 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:25.731486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:25.732089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:25.732380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:25.732666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:25.733953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:25.734260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:25.737081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:25.750187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 631/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:25.756581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:25.889457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42835ce-4e59-41bf-9670-ad2fcd344a8e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:25.919452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:25.929545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:25.930349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:25.930646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:25.930940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:25.938505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:25.940531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:58:25.956008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:25.957379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:25.958549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 622/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:25.963009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:26.023943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:26.073965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0d9bf-35ee-438d-9c43-08c06a966c64 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:26.115181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:26.115867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:26.116155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:26.116431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:26.117283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:26.117597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:26.119150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:26.138261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 632/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 14:58:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:26.145379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:26.256322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec447-0a27-4d45-aeac-ffd5d5ce6934 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:26.297865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:26.298704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:26.299162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:26.299576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:26.363708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:26.380101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:26.381564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:26.495386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 623/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:58:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 14:58:26.501999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:26.609672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7963b9-87d6-4bbb-a1bf-1e5281a0fd6b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:26.624356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:26.648088 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:26.648909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:26.649196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:26.649505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:26.661021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:26.662516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:26.681940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:26.683184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:26.684116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:26.684116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:26.684116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:26.684116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:26.687256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 633/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:26.689583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:26.782515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:26.800511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed33a4-ad5b-404a-9289-b3d82ed50e8c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:26.842145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:26.842819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:26.843131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:26.843412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:26.844150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:26.844459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:26.846498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:26.858760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 624/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:26.864716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:26.971526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f47c-d25e-48c4-b05a-0d5dad615c6a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:27.006932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:27.007768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:27.008055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:27.008334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:27.015118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:27.016615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:58:27.031157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:27.032389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:27.033274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 634/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:27.040061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:27.148579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf544f5-458f-4cd9-9b05-6ad00cce8abd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:27.181920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:27.182576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:27.182856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:27.183156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:27.183935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:27.184242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:27.185652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d997ae-d4b5-49d0-80c0-72c7dabc05d4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:27.197958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 625/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:27.204856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:27.230393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:27.304063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02a20d-6795-443d-a504-d792a8b22602 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:27.337444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:27.338095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:27.338384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:27.338667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:27.339532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=5581ec9275db47fa96f784326ec51e99) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:27.339852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:27.341458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b590c-c539-4496-9fbb-4c39ecf78c41 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:27.347081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 635/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:58:27 2022] GET /identity/v3/role_assignments?user.id=5581ec9275db47fa96f784326ec51e99&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:29.641421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a79081-219a-4bd4-b284-a44340b2b584 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:29.642651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a79081-219a-4bd4-b284-a44340b2b584 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:29.642651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a79081-219a-4bd4-b284-a44340b2b584 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:29.644091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 626/1261] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:29.649564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:29.649954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:29.650191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:29.668471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:29.669729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:29.735215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 636/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:29.757426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a79081-219a-4bd4-b284-a44340b2b584 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:29.769183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:29.873036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a79081-219a-4bd4-b284-a44340b2b584 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:29.909247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:29.909976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:29.910278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:29.910544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:29.920500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:58:29.928686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:29.929825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:58:29.930873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:29.934790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 627/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:29.935976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:29.955251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:30.038791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582fb3d-440d-4c69-b8cb-b36076dfa8a6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:30.074334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:30.074998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:30.075316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:30.075599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:30.076373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:30.076684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:30.078064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:30.086694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 637/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:30.092476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:30.161228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:30.196375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd238-9d3a-43c8-9317-f3c50d173d6a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:30.230607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:30.231423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:30.231713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:30.231997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:30.243125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:30.244659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:30.263327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:30.264333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:30.265316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:30.265316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:30.265316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:30.265316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:30.265316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 628/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:30.271104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:30.349453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:30.369312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7255f8c-42cd-482f-a25e-2c5ffd24caa5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:30.402560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:30.403242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:30.403528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:30.403807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:30.404522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:30.404827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:30.406187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:30.418337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 638/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:30.424355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:30.522430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75366eaf-b6f1-4919-aa2b-c55b50de85c2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:30.541486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:30.556209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:30.557000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:30.557281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:30.557555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:30.565524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:30.566937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:58:30.580976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:30.582068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:30.583423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 629/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:30.587937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:30.685863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aed05e-6d9e-4929-aa41-7d69392e2f4f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:30.719554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:30.721203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:30.721490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:30.721765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:30.722598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:30.722904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:30.724357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:30.732747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:30.742992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 639/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 14:58:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:30.748503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:30.860058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf41ec-d021-4c41-acfe-22a355a089ca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:30.893341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:30.894114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:30.894394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:30.894667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:30.904730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:30.906142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:30.925079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:30.926119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:30.927247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:30.927247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:30.927247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:30.927247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:30.927247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 630/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:30.931970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:31.029411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e957a-e83c-49ec-898b-7391ae198373 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:31.064370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:31.065032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:31.065323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:31.065604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:31.066327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:31.066635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:31.068055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:31.079015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 640/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:31.085289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:31.117122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:31.185866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0b4b-4477-4fa8-8953-2eb65fec0b69 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:31.219263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:31.220602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:31.220888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:31.221167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:31.227711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:31.229146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:58:31.243230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:31.244249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:31.245510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 631/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 14:58:31.250124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:31.306877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:31.347976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5a5b-b120-42af-a597-18f9330cd9a9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:31.379662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:31.380312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:31.380597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:31.380869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:31.381647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:31.381953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:31.383395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80959b-b884-4234-94a5-0e3a29be04c0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:31.395508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 641/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:31.401309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:31.491250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:31.510644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52391a-9a15-4b71-9b34-3ecedce74fae None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:31.544902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b77ca-4a9c-41a9-a886-0bdfe240b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:31.545788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b77ca-4a9c-41a9-a886-0bdfe240b7e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:31.546068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b77ca-4a9c-41a9-a886-0bdfe240b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:31.546344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b77ca-4a9c-41a9-a886-0bdfe240b7e0 None admin] PATH_INFO: `/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/5581ec9275db47fa96f784326ec51e99/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:31.548431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b77ca-4a9c-41a9-a886-0bdfe240b7e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca42592fd64c7a939af861dd81ed84, user_id=5581ec9275db47fa96f784326ec51e99, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:31.549853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b77ca-4a9c-41a9-a886-0bdfe240b7e0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:31.562948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 632/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Thu May 26 14:58:31 2022] PUT /identity/v3/projects/e6ca42592fd64c7a939af861dd81ed84/users/5581ec9275db47fa96f784326ec51e99/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 14:58:33.728494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22945048-90e9-46d3-bfae-cf33b79c20ef None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:33.729033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22945048-90e9-46d3-bfae-cf33b79c20ef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:33.729033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22945048-90e9-46d3-bfae-cf33b79c20ef None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:33.730422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 642/1274] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:33.735682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:33.736063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:33.736213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:33.753125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:33.754293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:33.824055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 633/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:33.856565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22945048-90e9-46d3-bfae-cf33b79c20ef None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:33.958578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22945048-90e9-46d3-bfae-cf33b79c20ef None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:33.975333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:33.992487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:33.993217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:33.993508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:33.993791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:34.004295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 14:58:34.012038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:34.013103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:34.013985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 643/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Thu May 26 14:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:34.019851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:34.099440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:34.119022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177d458-bbca-4aad-8212-14131a4c1186 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:34.152789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:34.153457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:34.153744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:34.154024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:34.154771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:34.155100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:34.156723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:34.164710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 634/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Thu May 26 14:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:34.170351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:34.269726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5266-2a2e-468d-a8cd-05fc5e2aec97 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:34.302424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:34.303228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:34.303520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:34.303796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:34.314888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:34.316374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:34.333418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:34.334505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:34.335695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:34.335695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:34.335695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:34.335695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:34.335695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 644/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:34.340399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:34.440068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cf82a-460a-4568-bd83-26f1c84be0d4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:34.472856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:34.473504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:34.473791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:34.474068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:34.474783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:34.475122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:34.476482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:34.488749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 635/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:34.494246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:34.524735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:34.595333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0228e5-27fe-4be9-aae0-040a444de3db None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:34.628398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:34.629189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:34.629477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:34.629755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:34.637069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:34.638529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 14:58:34.652718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:34.653789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:34.654964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 645/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:34.660428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:34.664175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:34.757569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cce7e-557a-4ec3-872e-0a8f726470b6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:34.793437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:34.794033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:34.794317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:34.794587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:34.795496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:34.795932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:34.797351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:34.815923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 636/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Thu May 26 14:58:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:34.821587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:34.911879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:34.922118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c9c54-76c9-4bdd-9294-ca9c21a456a8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:34.955344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:34.955984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:34.956275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:34.956556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:35.022170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:35.023676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:35.111169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:35.121865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 646/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Thu May 26 14:58:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 14:58:35.128395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:35.187710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:35.225722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209bbe5-55b7-4b89-8514-dac6753ea39c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:35.259318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:35.260106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:35.260393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:35.260673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:35.270462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:35.271932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 14:58:35.289994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:35.291061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:35.292179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 14:58:35.292179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 14:58:35.292179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 14:58:35.292179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:35.292179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 637/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 14:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:35.296817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:35.393274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e902-e71b-49df-824d-8bb969397283 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:35.427290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:35.427946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:35.428236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:35.428519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:35.429244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:35.429555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:35.430930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:35.441983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 647/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Thu May 26 14:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:35.447466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:35.545834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7c33a-a651-4225-a525-d9d43e325c86 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:35.560777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:35.581261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:35.582057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:35.582344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:35.582620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:35.589230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:35.590679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 14:58:35.604829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:35.605884 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 26 14:58:35.606993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 638/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Thu May 26 14:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:35.612830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:35.664097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:35.712824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecf16-46d0-4d5c-9486-a0efabd8b2af None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:35.745222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:35.745875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:35.746160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:35.746439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:35.747256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:35.747567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:35.749001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095c139-763c-4bd7-a5bd-fa8e429a9b27 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:35.761142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 648/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Thu May 26 14:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:35.767826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:35.870090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfde97-b31a-4d40-be53-eb8dd9864b5e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:35.904018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:35.904671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:35.904957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:35.905237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:35.906071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] RBAC: Adding query filter params (role.id=1b534f74d3ee4742a18eb90532175f3c, scope.project.id=e6ca42592fd64c7a939af861dd81ed84, user.id=5581ec9275db47fa96f784326ec51e99) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:35.906643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:35.908770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dbf4-55c8-48a7-89da-b9263f9825d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:35.914696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 639/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Thu May 26 14:58:35 2022] GET /identity/v3/role_assignments?user.id=5581ec9275db47fa96f784326ec51e99&scope.project.id=e6ca42592fd64c7a939af861dd81ed84&role.id=1b534f74d3ee4742a18eb90532175f3c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:38.131907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32706a-1eb7-48a8-a613-44ded4030aa6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:38.132424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32706a-1eb7-48a8-a613-44ded4030aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:38.132516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32706a-1eb7-48a8-a613-44ded4030aa6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:38.133824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 649/1288] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:38.139005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:38.139435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:38.139609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:38.158421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:38.159633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:38.188023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:38.226195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 640/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:38.247947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32706a-1eb7-48a8-a613-44ded4030aa6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:38.348857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32706a-1eb7-48a8-a613-44ded4030aa6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:38.359101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:38.383100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:38.383907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:38.384193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:38.384468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:38.385113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:38.386491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:38.398737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:38.399999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:38.401063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 650/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:58:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:38.406057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:38.503301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c566e-2e35-435a-b5a8-c00383b21b4c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:38.536625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:38.537279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:38.537573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:38.537853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:38.538556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:38.538863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:38.540261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5774b43-08eb-4017-8492-5a7d8ee76458 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:38.545006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 641/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 14:58:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:38.550756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:38.649714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffc10-c6e6-4fdd-a34d-8070550d75f6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:38.682634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:38.683327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:38.683618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:38.683899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:38.684609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:38.684924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:38.686294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5846c3-7ae5-4c39-980f-ff1da9a9aff1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:38.691483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 651/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 14:58:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:40.865391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593879-70d0-4ede-bfe7-c792769a3df4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:40.866001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593879-70d0-4ede-bfe7-c792769a3df4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:40.866001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58593879-70d0-4ede-bfe7-c792769a3df4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:40.867349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 642/1293] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:40.872521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba243-48b8-459b-9279-1931de0ef71e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:40.872960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba243-48b8-459b-9279-1931de0ef71e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:40.873092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba243-48b8-459b-9279-1931de0ef71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:40.889503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-44dba243-48b8-459b-9279-1931de0ef71e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:40.890680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-44dba243-48b8-459b-9279-1931de0ef71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:40.920586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:40.958358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 652/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:40.981333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58593879-70d0-4ede-bfe7-c792769a3df4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:41.011840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:41.084039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58593879-70d0-4ede-bfe7-c792769a3df4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:41.117582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd0f04-97f6-42f6-91c6-26ad82117bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:41.118173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd0f04-97f6-42f6-91c6-26ad82117bf3 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:41.118455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd0f04-97f6-42f6-91c6-26ad82117bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:41.118732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd0f04-97f6-42f6-91c6-26ad82117bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:41.119489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd0f04-97f6-42f6-91c6-26ad82117bf3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:41.120843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd0f04-97f6-42f6-91c6-26ad82117bf3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:41.133234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 643/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Thu May 26 14:58:40 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 14:58:43.355481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce249-04e3-44c9-b12d-1b567162d9fd None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:43.356001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce249-04e3-44c9-b12d-1b567162d9fd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:43.356001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce249-04e3-44c9-b12d-1b567162d9fd None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:43.357344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 653/1296] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:43.362839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:43.363310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:43.363413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:43.379749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:43.380919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:43.451371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 644/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:43.474674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefce249-04e3-44c9-b12d-1b567162d9fd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:43.573559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefce249-04e3-44c9-b12d-1b567162d9fd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:43.606642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:43.607394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:43.607682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:43.607962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:43.608614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:43.610038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:43.621758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:43.623054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:43.624269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 654/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:58:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:43.629637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:43.651506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:43.732606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e91d6-0871-4f20-8967-7d85ef6b38e0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:43.765636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:43.766912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:43.767235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:43.767520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:43.768229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:43.768540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:43.769908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:43.774983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 645/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 14:58:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:43.781046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:43.811973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:43.880112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccea3a-2b97-4e36-827b-db97913f85e5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:43.912749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:43.913405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:43.913695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:43.913976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:43.914775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] RBAC: Adding query filter params (interface=public, service_id=9eb294cdd37a443bb290929a7a9330ef, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:43.915117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:43.916482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2de8b-69b2-4dc6-8c84-8721505fe611 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:43.921451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 655/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Thu May 26 14:58:43 2022] GET /identity/v3/endpoints?service_id=9eb294cdd37a443bb290929a7a9330ef&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:43.927599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:44.007281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:44.025395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c84ae-3b3f-4317-a1f9-a44699d4ce6b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:44.059680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c18b-1b52-47e6-95b5-a0cbaa3046ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:44.060344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c18b-1b52-47e6-95b5-a0cbaa3046ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:44.060633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c18b-1b52-47e6-95b5-a0cbaa3046ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:44.060913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c18b-1b52-47e6-95b5-a0cbaa3046ad None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:44.061592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c18b-1b52-47e6-95b5-a0cbaa3046ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:44.062958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c18b-1b52-47e6-95b5-a0cbaa3046ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:44.070351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 646/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Thu May 26 14:58:43 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 14:58:46.243112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8f74-81a6-4138-a9a6-589d93c18fd1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:46.243638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8f74-81a6-4138-a9a6-589d93c18fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:46.243749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8f74-81a6-4138-a9a6-589d93c18fd1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:46.245046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 656/1302] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:58:46.250376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:46.250787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:46.250939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:46.269469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:58:46.270634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:58:46.337714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 647/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:58:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 14:58:46.361452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8f74-81a6-4138-a9a6-589d93c18fd1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:46.461029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:46.467962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8f74-81a6-4138-a9a6-589d93c18fd1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:46.502476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:46.503298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:46.503585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:46.503871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:46.504523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:46.505896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 14:58:46.517806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 14:58:46.519008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 14:58:46.520108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 26 14:58:46.523239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 657/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Thu May 26 14:58:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 14:58:46.525118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:46.600949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:46.624065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89f6a-081f-4aee-8dcc-0abb3e8b8176 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:46.656599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:46.657848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:46.658134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:46.658410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:46.659127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 14:58:46.659437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:46.660795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece29ed-552f-430e-b6c4-3899b6f853b0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:46.665968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 648/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Thu May 26 14:58:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 14:58:46.671653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:58:46.770176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c76ff-2195-43d5-8668-b07207446ce6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:58:46.803350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c54b-0adc-4ecd-b722-515d14dd04f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:58:46.803993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c54b-0adc-4ecd-b722-515d14dd04f4 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:58:46.804279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c54b-0adc-4ecd-b722-515d14dd04f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:58:46.804558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c54b-0adc-4ecd-b722-515d14dd04f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:58:46.805305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c54b-0adc-4ecd-b722-515d14dd04f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:58:46.806685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c54b-0adc-4ecd-b722-515d14dd04f4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:58:46.824925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 658/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Thu May 26 14:58:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 14:58:56.662830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=30 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:58:56.820847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:50.561905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f3355-3706-413a-a6b3-ce8a75c4dd79 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:50.562485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f3355-3706-413a-a6b3-ce8a75c4dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:50.562584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f3355-3706-413a-a6b3-ce8a75c4dd79 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:50.569796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b15c3-c986-4d17-a7f7-2ad9dc72e756 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:50.570211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b15c3-c986-4d17-a7f7-2ad9dc72e756 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:50.570211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b15c3-c986-4d17-a7f7-2ad9dc72e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:50.575520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 649/1307] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:59:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:59:50.656773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-266b15c3-c986-4d17-a7f7-2ad9dc72e756 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:59:50.658222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-266b15c3-c986-4d17-a7f7-2ad9dc72e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:50.860122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 659/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:59:50.919077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764cc7-7c6c-470b-935e-58ea9d1d00e8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:50.919304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764cc7-7c6c-470b-935e-58ea9d1d00e8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:50.919589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764cc7-7c6c-470b-935e-58ea9d1d00e8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:50.921641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 650/1309] 10.222.0.45 () {54 vars in 964 bytes} [Thu May 26 14:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:59:50.930353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df33d-daea-4462-91f8-db440098bbd2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:50.930659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df33d-daea-4462-91f8-db440098bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:50.930946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df33d-daea-4462-91f8-db440098bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:51.030178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-744df33d-daea-4462-91f8-db440098bbd2 None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:59:51.031801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-744df33d-daea-4462-91f8-db440098bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:51.054935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:51.118641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 660/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Thu May 26 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:59:51.129145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a764cc7-7c6c-470b-935e-58ea9d1d00e8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:59:51.131240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1a764cc7-7c6c-470b-935e-58ea9d1d00e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:51.263919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a764cc7-7c6c-470b-935e-58ea9d1d00e8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:59:51.344229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:59:51.345010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:51.345368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:51.345725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:51.347505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:51.405928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:51.464019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:59:51.465462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566733-0a08-4d66-a48a-cca7f7dce4e7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:59:51.485718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 651/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:59:54.006950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113e6fc-4371-445e-8c63-9de29ceb79f8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:54.007541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113e6fc-4371-445e-8c63-9de29ceb79f8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:54.007541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113e6fc-4371-445e-8c63-9de29ceb79f8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:54.010754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 661/1312] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:59:54.014504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bdad0-f7d3-497a-8953-6860c0c5a181 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:54.014504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bdad0-f7d3-497a-8953-6860c0c5a181 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:54.015440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bdad0-f7d3-497a-8953-6860c0c5a181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:54.104904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e75bdad0-f7d3-497a-8953-6860c0c5a181 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:59:54.106026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e75bdad0-f7d3-497a-8953-6860c0c5a181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:54.210763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 652/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:59:54.249889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113e6fc-4371-445e-8c63-9de29ceb79f8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:59:54.251628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c113e6fc-4371-445e-8c63-9de29ceb79f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:54.363639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113e6fc-4371-445e-8c63-9de29ceb79f8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:59:54.441378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:54.444007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:59:54.444668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:54.444960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:54.445232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:54.447529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:54.574606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:59:54.576094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bbca3-cc23-4ab2-a3f1-f8d3d899ec40 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:59:54.595430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 662/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 14:59:57.191017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831820-db6e-47f3-9240-731bd90e2188 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:57.191592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831820-db6e-47f3-9240-731bd90e2188 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:57.191687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831820-db6e-47f3-9240-731bd90e2188 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:57.193024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 653/1315] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 14:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 14:59:57.198295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167880c-cdd9-46c4-9863-9eee9c07bb53 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:57.198732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167880c-cdd9-46c4-9863-9eee9c07bb53 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:57.198860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167880c-cdd9-46c4-9863-9eee9c07bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:57.262693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8167880c-cdd9-46c4-9863-9eee9c07bb53 None None] MFA Rules not processed for user `4341a8c3a5294dcfa0689edce871eeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 14:59:57.263837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8167880c-cdd9-46c4-9863-9eee9c07bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:57.315510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:57.360267 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 663/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 14:59:57.399954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53831820-db6e-47f3-9240-731bd90e2188 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 14:59:57.401493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53831820-db6e-47f3-9240-731bd90e2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:57.411790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:57.506806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53831820-db6e-47f3-9240-731bd90e2188 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 14:59:57.583079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 14:59:57.583742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 14:59:57.584024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 14:59:57.584300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 14:59:57.585934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 14:59:57.647879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:59:57.695828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 14:59:57.697311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4194d0-b8e6-41f6-90c9-5835fe7823eb service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 14:59:57.715566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 654/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:00.453640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeed62-2b87-468c-b914-b55eb9bb9e91 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:00.454138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeed62-2b87-468c-b914-b55eb9bb9e91 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:00.454254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeed62-2b87-468c-b914-b55eb9bb9e91 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:00.455639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 664/1318] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:00.460810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767130b5-1fab-4ca7-88c2-50a11dc2f1d0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:00.461187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767130b5-1fab-4ca7-88c2-50a11dc2f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:00.461382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767130b5-1fab-4ca7-88c2-50a11dc2f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:00.526582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-767130b5-1fab-4ca7-88c2-50a11dc2f1d0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:00.527802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-767130b5-1fab-4ca7-88c2-50a11dc2f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:00.626165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 655/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:00.677769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517edfe5-c01d-4891-83e7-34f8ae6d15f1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:00.678061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517edfe5-c01d-4891-83e7-34f8ae6d15f1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:00.678343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517edfe5-c01d-4891-83e7-34f8ae6d15f1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:00.679764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 665/1320] 10.222.0.45 () {54 vars in 964 bytes} [Thu May 26 15:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:00.685417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fcdfb-ede2-4ee9-88bf-ea98f9857189 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:00.685706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fcdfb-ede2-4ee9-88bf-ea98f9857189 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:00.686668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fcdfb-ede2-4ee9-88bf-ea98f9857189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:00.707807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:00.762187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-718fcdfb-ede2-4ee9-88bf-ea98f9857189 None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:00.763432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-718fcdfb-ede2-4ee9-88bf-ea98f9857189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:00.840898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 656/1321] 10.222.0.45 () {58 vars in 1061 bytes} [Thu May 26 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:00.850123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517edfe5-c01d-4891-83e7-34f8ae6d15f1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:00.851690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-517edfe5-c01d-4891-83e7-34f8ae6d15f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:00.957894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517edfe5-c01d-4891-83e7-34f8ae6d15f1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:01.029989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:01.030901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:01.031220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:01.031501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:01.033179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:01.040814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:01.144020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:01.145468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481af70-1085-4b84-88f9-28e93ea33f1b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:01.163418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 666/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:04.490847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8095316-1c2e-45d0-b965-466ca0a9cdd0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:04.491436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8095316-1c2e-45d0-b965-466ca0a9cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:04.491436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8095316-1c2e-45d0-b965-466ca0a9cdd0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:04.492927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 657/1323] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:04.498890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e557-2095-4b4b-8cff-292b8a3e7c88 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:04.499504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e557-2095-4b4b-8cff-292b8a3e7c88 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:04.499504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e557-2095-4b4b-8cff-292b8a3e7c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:04.564603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3002e557-2095-4b4b-8cff-292b8a3e7c88 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:04.565795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3002e557-2095-4b4b-8cff-292b8a3e7c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:04.625374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:04.666273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 667/1324] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:04.703019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8095316-1c2e-45d0-b965-466ca0a9cdd0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:04.704734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c8095316-1c2e-45d0-b965-466ca0a9cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:04.814756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8095316-1c2e-45d0-b965-466ca0a9cdd0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:04.827041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:04.892676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:04.893332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:04.893621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:04.893904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:04.895595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:05.011307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:05.012674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adebaf-3c50-4944-a872-edf8106fd410 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:05.034588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 658/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:00:07.301086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967cb9-880a-47ff-bc0d-0ff82662a56d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:07.301639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967cb9-880a-47ff-bc0d-0ff82662a56d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:07.301639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967cb9-880a-47ff-bc0d-0ff82662a56d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:07.302977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 668/1326] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:07.308131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a90af-460c-4401-8d6f-96de5755ed04 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:07.308581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a90af-460c-4401-8d6f-96de5755ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:07.308705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a90af-460c-4401-8d6f-96de5755ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:07.356501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:07.376245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b16a90af-460c-4401-8d6f-96de5755ed04 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:07.378593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b16a90af-460c-4401-8d6f-96de5755ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:07.479986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 659/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:07.516488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21967cb9-880a-47ff-bc0d-0ff82662a56d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:07.518177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-21967cb9-880a-47ff-bc0d-0ff82662a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:07.621690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21967cb9-880a-47ff-bc0d-0ff82662a56d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:07.695341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:07.695997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:07.696284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:07.696565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:07.698209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:07.716168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:07.814228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:07.815730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b98d1-a983-4453-8118-f457d9a890ca service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:07.834026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 669/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:10.114252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5fe90-986d-439b-a983-f35e1862950b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:10.114851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5fe90-986d-439b-a983-f35e1862950b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:10.114851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5fe90-986d-439b-a983-f35e1862950b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:10.116245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 660/1329] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:10.121585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03556e6-f2e3-457a-b5bc-4c87a1eb6616 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:10.122009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03556e6-f2e3-457a-b5bc-4c87a1eb6616 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:10.122153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03556e6-f2e3-457a-b5bc-4c87a1eb6616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:10.187197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d03556e6-f2e3-457a-b5bc-4c87a1eb6616 None None] MFA Rules not processed for user `4341a8c3a5294dcfa0689edce871eeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:10.188411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d03556e6-f2e3-457a-b5bc-4c87a1eb6616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:10.253754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:10.288606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 670/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:10.326281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5fe90-986d-439b-a983-f35e1862950b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:10.327846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29b5fe90-986d-439b-a983-f35e1862950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:10.434243 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5fe90-986d-439b-a983-f35e1862950b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:10.456351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:10.513364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:10.514098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:10.514416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:10.514675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:10.516330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:10.627832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:10.629186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d3c3-eab4-41f6-bf80-234e62a97cd7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:10.647550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 661/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:13.131558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae059595-13e7-4d70-8d72-230bcad86af6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:13.132133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae059595-13e7-4d70-8d72-230bcad86af6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:13.132133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae059595-13e7-4d70-8d72-230bcad86af6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:13.133507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 671/1332] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:13.139471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed0bb-155e-480e-b4d0-67f74df69e2f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:13.139937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed0bb-155e-480e-b4d0-67f74df69e2f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:13.140071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed0bb-155e-480e-b4d0-67f74df69e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:13.205318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:13.208307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bc8ed0bb-155e-480e-b4d0-67f74df69e2f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:13.210288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bc8ed0bb-155e-480e-b4d0-67f74df69e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:13.312662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 662/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:00:13.348305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae059595-13e7-4d70-8d72-230bcad86af6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:13.349868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ae059595-13e7-4d70-8d72-230bcad86af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:13.458384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae059595-13e7-4d70-8d72-230bcad86af6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:13.533459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:13.534034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:13.534322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:13.534605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:13.536381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:13.566032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:13.654886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:13.656663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bffe9-3741-4c79-95df-fce754cc0215 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:13.676331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 672/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:15.940998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a23b3-3719-47db-bdb0-cd94469eb41e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:15.941575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a23b3-3719-47db-bdb0-cd94469eb41e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:15.941575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a23b3-3719-47db-bdb0-cd94469eb41e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:15.942943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 663/1335] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:15.948170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3a07-592a-4d09-8a0f-d0462394cde4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:15.948598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3a07-592a-4d09-8a0f-d0462394cde4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:15.948713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3a07-592a-4d09-8a0f-d0462394cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:16.013214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e63a3a07-592a-4d09-8a0f-d0462394cde4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:16.015009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e63a3a07-592a-4d09-8a0f-d0462394cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:16.090018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:16.114231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 673/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:16.153771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a23b3-3719-47db-bdb0-cd94469eb41e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:16.155919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ed5a23b3-3719-47db-bdb0-cd94469eb41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:16.258592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a23b3-3719-47db-bdb0-cd94469eb41e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:16.287720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:16.332374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:16.333049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:16.333334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:16.333610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:16.335270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:16.453140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:16.454586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580b7d-187d-446c-87aa-db0713f1c28e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:16.474110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 664/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:19.035607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57542-0058-48ba-ae7e-d4b6a1abbd1f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:19.036157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57542-0058-48ba-ae7e-d4b6a1abbd1f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:19.036243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57542-0058-48ba-ae7e-d4b6a1abbd1f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:19.037635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 674/1338] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:19.042923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec690f1-3577-4129-95e4-1e46b6f1258d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:19.043333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec690f1-3577-4129-95e4-1e46b6f1258d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:19.043576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec690f1-3577-4129-95e4-1e46b6f1258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:19.110110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5ec690f1-3577-4129-95e4-1e46b6f1258d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:19.111378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5ec690f1-3577-4129-95e4-1e46b6f1258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:19.119609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:19.209942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 665/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:19.245162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e57542-0058-48ba-ae7e-d4b6a1abbd1f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:19.246705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-29e57542-0058-48ba-ae7e-d4b6a1abbd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:19.349013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e57542-0058-48ba-ae7e-d4b6a1abbd1f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:19.421583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:19.422241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:19.422530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:19.422811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:19.424500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:19.459916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:19.535625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:19.537085 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864f2dc-d5e0-43d6-8a0c-476ae34d570f service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:19.557115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 675/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:23.945802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebfe88-8bc2-4c07-94cc-92cbdd41b20f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:23.946328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebfe88-8bc2-4c07-94cc-92cbdd41b20f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:23.946328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebfe88-8bc2-4c07-94cc-92cbdd41b20f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:23.947802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 666/1341] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:23.953591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e308d-cf22-4b20-b428-8b06a7905077 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:23.954012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e308d-cf22-4b20-b428-8b06a7905077 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:23.954304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e308d-cf22-4b20-b428-8b06a7905077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:24.026800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f98e308d-cf22-4b20-b428-8b06a7905077 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:24.028037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f98e308d-cf22-4b20-b428-8b06a7905077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:24.124463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:24.138038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 676/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:24.177686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebfe88-8bc2-4c07-94cc-92cbdd41b20f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:24.179869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1ebfe88-8bc2-4c07-94cc-92cbdd41b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:24.277009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebfe88-8bc2-4c07-94cc-92cbdd41b20f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:24.281667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7963b-60b3-4deb-8a48-2a9a5ea784dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:24.282321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7963b-60b3-4deb-8a48-2a9a5ea784dd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:24.282610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7963b-60b3-4deb-8a48-2a9a5ea784dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:24.282891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7963b-60b3-4deb-8a48-2a9a5ea784dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:24.292003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7963b-60b3-4deb-8a48-2a9a5ea784dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:24.293436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7963b-60b3-4deb-8a48-2a9a5ea784dd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:24.303767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 667/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:27.112656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbefe2-9993-43c0-a4af-db77fc410237 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:27.113181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbefe2-9993-43c0-a4af-db77fc410237 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:27.113276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbefe2-9993-43c0-a4af-db77fc410237 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:27.114615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 677/1344] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:27.119822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee558f-1fb7-4489-aa47-0ec23258c17a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:27.120252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee558f-1fb7-4489-aa47-0ec23258c17a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:27.120376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee558f-1fb7-4489-aa47-0ec23258c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:27.148234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e3ee558f-1fb7-4489-aa47-0ec23258c17a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:27.149561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e3ee558f-1fb7-4489-aa47-0ec23258c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:27.178632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:27.228705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 668/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:27.265883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbefe2-9993-43c0-a4af-db77fc410237 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:27.276893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbefe2-9993-43c0-a4af-db77fc410237 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:27.281311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce74b01-0bda-4f21-9e76-c5af2fee5f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:27.281960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74b01-0bda-4f21-9e76-c5af2fee5f79 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:27.282249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74b01-0bda-4f21-9e76-c5af2fee5f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:27.282922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74b01-0bda-4f21-9e76-c5af2fee5f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:27.292335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce74b01-0bda-4f21-9e76-c5af2fee5f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:27.293816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce74b01-0bda-4f21-9e76-c5af2fee5f79 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:27.304196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 678/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:31.639118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a18fec-6bf8-40d0-aae6-8c5be369f4a2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:31.639632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a18fec-6bf8-40d0-aae6-8c5be369f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:31.639731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a18fec-6bf8-40d0-aae6-8c5be369f4a2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:31.641206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 669/1347] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:31.646479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee8778-7f60-4016-ad32-e4f266e059af None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:31.646938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee8778-7f60-4016-ad32-e4f266e059af None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:31.647042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee8778-7f60-4016-ad32-e4f266e059af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:31.665361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7cee8778-7f60-4016-ad32-e4f266e059af None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:31.666556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7cee8778-7f60-4016-ad32-e4f266e059af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:31.675223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 679/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:31.712792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a18fec-6bf8-40d0-aae6-8c5be369f4a2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:31.724323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a18fec-6bf8-40d0-aae6-8c5be369f4a2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:31.727908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a21d8d-8472-4e94-9d36-22b6fcac158c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:31.728552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a21d8d-8472-4e94-9d36-22b6fcac158c service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:31.728841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a21d8d-8472-4e94-9d36-22b6fcac158c service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:31.729125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a21d8d-8472-4e94-9d36-22b6fcac158c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:31.739131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a21d8d-8472-4e94-9d36-22b6fcac158c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:31.740570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a21d8d-8472-4e94-9d36-22b6fcac158c service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:31.750524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 670/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:37.190270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f5d8-9c64-48a2-bbb7-80bc88350730 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:37.190806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f5d8-9c64-48a2-bbb7-80bc88350730 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:37.191126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f5d8-9c64-48a2-bbb7-80bc88350730 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:37.192659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 680/1350] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:37.198636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553481-ab9f-4adf-87ce-1af5ffb431a9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:37.199127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553481-ab9f-4adf-87ce-1af5ffb431a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:37.199216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553481-ab9f-4adf-87ce-1af5ffb431a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:37.289959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-12553481-ab9f-4adf-87ce-1af5ffb431a9 None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:37.291228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-12553481-ab9f-4adf-87ce-1af5ffb431a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:37.430911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 671/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:41.507148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b638-01c3-4836-9041-777f64b2d689 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:41.507642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b638-01c3-4836-9041-777f64b2d689 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:41.507642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b638-01c3-4836-9041-777f64b2d689 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:41.509007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 681/1352] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:41.514356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b29d3-d430-4b8e-b21b-14dc5dfd0e63 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:41.515312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b29d3-d430-4b8e-b21b-14dc5dfd0e63 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:41.515828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b29d3-d430-4b8e-b21b-14dc5dfd0e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:41.536206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2b3b29d3-d430-4b8e-b21b-14dc5dfd0e63 None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:41.537410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2b3b29d3-d430-4b8e-b21b-14dc5dfd0e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:41.547147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 672/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:41.660922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=13 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:43.202429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047054fa-48e6-4f33-aa59-fe0cbcf53891 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:43.203114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047054fa-48e6-4f33-aa59-fe0cbcf53891 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:43.203114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047054fa-48e6-4f33-aa59-fe0cbcf53891 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:43.204388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 682/1354] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:43.209417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9715616-0bf1-46da-8bc9-c358daa1b12c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:43.209872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9715616-0bf1-46da-8bc9-c358daa1b12c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:43.209970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9715616-0bf1-46da-8bc9-c358daa1b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:43.228768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9715616-0bf1-46da-8bc9-c358daa1b12c None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:43.229955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9715616-0bf1-46da-8bc9-c358daa1b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:43.238686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 673/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:47.186881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af555c5-51fd-4047-bc40-50d950578e5d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:47.187440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af555c5-51fd-4047-bc40-50d950578e5d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:47.187534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af555c5-51fd-4047-bc40-50d950578e5d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:47.192790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 683/1356] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:47.194188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ead1b4-fbad-4c38-b849-0793f10fab0f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:47.194605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ead1b4-fbad-4c38-b849-0793f10fab0f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:47.194759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ead1b4-fbad-4c38-b849-0793f10fab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:47.213048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c3ead1b4-fbad-4c38-b849-0793f10fab0f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:47.214236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c3ead1b4-fbad-4c38-b849-0793f10fab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:47.222820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 674/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:00:47.279421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b75dcd-b0e4-415d-8f5f-593e8c0ea70e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:47.279806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b75dcd-b0e4-415d-8f5f-593e8c0ea70e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:47.280577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b75dcd-b0e4-415d-8f5f-593e8c0ea70e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:47.283228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 684/1358] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 15:00:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:47.290578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff455e64-3956-4130-92c8-8d1f7b839476 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:47.293667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff455e64-3956-4130-92c8-8d1f7b839476 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:47.294720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff455e64-3956-4130-92c8-8d1f7b839476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:47.342349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:47.351021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ff455e64-3956-4130-92c8-8d1f7b839476 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:47.352317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff455e64-3956-4130-92c8-8d1f7b839476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:47.438378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 675/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:47.447417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b75dcd-b0e4-415d-8f5f-593e8c0ea70e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:47.477677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b75dcd-b0e4-415d-8f5f-593e8c0ea70e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:47.484449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2a6d2-1622-4fab-b6aa-d6bcb7e4d30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:47.485636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2a6d2-1622-4fab-b6aa-d6bcb7e4d30d service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:47.486229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2a6d2-1622-4fab-b6aa-d6bcb7e4d30d service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:47.486349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2a6d2-1622-4fab-b6aa-d6bcb7e4d30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:47.499539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2a6d2-1622-4fab-b6aa-d6bcb7e4d30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:47.501301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2a6d2-1622-4fab-b6aa-d6bcb7e4d30d service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:47.514027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 685/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:49.978820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3b65b-c285-4335-971e-cb6d3dea62c1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:49.979359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3b65b-c285-4335-971e-cb6d3dea62c1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:49.979359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3b65b-c285-4335-971e-cb6d3dea62c1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:49.980868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 676/1361] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:49.986411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b3256-1a0b-4ed9-8143-026e6b032eb9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:49.986821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b3256-1a0b-4ed9-8143-026e6b032eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:49.986970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b3256-1a0b-4ed9-8143-026e6b032eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:50.005371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-020b3256-1a0b-4ed9-8143-026e6b032eb9 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:50.006834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-020b3256-1a0b-4ed9-8143-026e6b032eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:50.015627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 686/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:50.063571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3b65b-c285-4335-971e-cb6d3dea62c1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:50.082114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3b65b-c285-4335-971e-cb6d3dea62c1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:50.088436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a59ff5-aece-483e-9ed5-bf2543c09a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:50.089084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a59ff5-aece-483e-9ed5-bf2543c09a3e service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:50.089371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a59ff5-aece-483e-9ed5-bf2543c09a3e service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:50.089652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a59ff5-aece-483e-9ed5-bf2543c09a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:50.100554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a59ff5-aece-483e-9ed5-bf2543c09a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:50.102295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a59ff5-aece-483e-9ed5-bf2543c09a3e service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:50.114671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 677/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:52.678068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b79049-2dcc-4fd3-a16c-3bc9a9b98599 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:52.678577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b79049-2dcc-4fd3-a16c-3bc9a9b98599 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:52.678686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b79049-2dcc-4fd3-a16c-3bc9a9b98599 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:52.680189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 687/1364] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:52.685827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c8756-6a0e-49fa-85cd-0c9a852f3104 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:52.686246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c8756-6a0e-49fa-85cd-0c9a852f3104 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:52.686393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c8756-6a0e-49fa-85cd-0c9a852f3104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:52.707620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f31c8756-6a0e-49fa-85cd-0c9a852f3104 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:52.707620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f31c8756-6a0e-49fa-85cd-0c9a852f3104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:52.715684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 678/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:52.777701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0bec-f6d8-4f6f-afe2-24f97ab96e9f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:52.778009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0bec-f6d8-4f6f-afe2-24f97ab96e9f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:52.778805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0bec-f6d8-4f6f-afe2-24f97ab96e9f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:52.781033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 688/1366] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 15:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:52.792631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79726b9-6cd1-4475-8953-e975613d1663 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:52.793611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79726b9-6cd1-4475-8953-e975613d1663 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:52.793905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79726b9-6cd1-4475-8953-e975613d1663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:52.818312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c79726b9-6cd1-4475-8953-e975613d1663 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:52.819563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c79726b9-6cd1-4475-8953-e975613d1663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:52.830146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 679/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:52.838384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b0bec-f6d8-4f6f-afe2-24f97ab96e9f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:52.853751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b0bec-f6d8-4f6f-afe2-24f97ab96e9f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:52.860068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe49c-1bca-40fd-9a18-d440720f843d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:52.860729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe49c-1bca-40fd-9a18-d440720f843d service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:52.861042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe49c-1bca-40fd-9a18-d440720f843d service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:52.861324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe49c-1bca-40fd-9a18-d440720f843d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:52.869762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe49c-1bca-40fd-9a18-d440720f843d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:52.871387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe49c-1bca-40fd-9a18-d440720f843d service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:52.881142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 689/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:55.165272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fc302-199a-4063-aa9b-4bc03a25df40 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.165845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fc302-199a-4063-aa9b-4bc03a25df40 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.165845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fc302-199a-4063-aa9b-4bc03a25df40 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.167232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 680/1369] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:55.172718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245592-eb1f-49cb-b48c-d19b130a668b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.173152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245592-eb1f-49cb-b48c-d19b130a668b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.173284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0245592-eb1f-49cb-b48c-d19b130a668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.192100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d0245592-eb1f-49cb-b48c-d19b130a668b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:55.193304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d0245592-eb1f-49cb-b48c-d19b130a668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:55.203224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 690/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:55.246461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fc302-199a-4063-aa9b-4bc03a25df40 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:55.261592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fc302-199a-4063-aa9b-4bc03a25df40 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:55.268127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaa8b8-420b-498a-a94c-bc3c868fd584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:55.269064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaa8b8-420b-498a-a94c-bc3c868fd584 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.269570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaa8b8-420b-498a-a94c-bc3c868fd584 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.270063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaa8b8-420b-498a-a94c-bc3c868fd584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.280822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaa8b8-420b-498a-a94c-bc3c868fd584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:55.282462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaa8b8-420b-498a-a94c-bc3c868fd584 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:55.293908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 681/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:55.485910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d7a2-6c09-49eb-b9c9-1966afdca6ba None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.486210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d7a2-6c09-49eb-b9c9-1966afdca6ba None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.486498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d7a2-6c09-49eb-b9c9-1966afdca6ba None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.487922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 691/1372] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:55.497855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117173-94b0-45e0-9c7a-ba7d2270231b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.498322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117173-94b0-45e0-9c7a-ba7d2270231b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.498915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117173-94b0-45e0-9c7a-ba7d2270231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.518382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-65117173-94b0-45e0-9c7a-ba7d2270231b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:55.519656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-65117173-94b0-45e0-9c7a-ba7d2270231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:55.528101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 682/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:55.809167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a61f9-176a-460b-bea9-81735e313840 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.810079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a61f9-176a-460b-bea9-81735e313840 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.810535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a61f9-176a-460b-bea9-81735e313840 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.812323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 692/1374] 10.222.0.45 () {54 vars in 963 bytes} [Thu May 26 15:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:55.818674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbfa66-b8ee-4c07-823e-ef2b916ac2e0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.819008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbfa66-b8ee-4c07-823e-ef2b916ac2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.819301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbfa66-b8ee-4c07-823e-ef2b916ac2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.876946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-46cbfa66-b8ee-4c07-823e-ef2b916ac2e0 None None] MFA Rules not processed for user `20eba02f87c74008b2fcb4c89c81df34`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:55.878898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-46cbfa66-b8ee-4c07-823e-ef2b916ac2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:55.946615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 683/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Thu May 26 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:55.954966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a61f9-176a-460b-bea9-81735e313840 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:55.965751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a61f9-176a-460b-bea9-81735e313840 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:55.969469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1365-b8ae-4b73-899f-285b472d2a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:55.970188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1365-b8ae-4b73-899f-285b472d2a64 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:55.970541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1365-b8ae-4b73-899f-285b472d2a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:55.970908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1365-b8ae-4b73-899f-285b472d2a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:55.980256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1365-b8ae-4b73-899f-285b472d2a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:55.982283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1365-b8ae-4b73-899f-285b472d2a64 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:55.992405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 693/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:57.592435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1380e-8904-4feb-9252-9031b03cece3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:57.593061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1380e-8904-4feb-9252-9031b03cece3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:57.593061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1380e-8904-4feb-9252-9031b03cece3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:57.594405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 684/1377] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:00:57.600432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8cd4d-6d65-4a3a-a0ce-3d33bf7c4664 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:57.600982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8cd4d-6d65-4a3a-a0ce-3d33bf7c4664 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:57.600982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8cd4d-6d65-4a3a-a0ce-3d33bf7c4664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:57.621320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fba8cd4d-6d65-4a3a-a0ce-3d33bf7c4664 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:00:57.623718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fba8cd4d-6d65-4a3a-a0ce-3d33bf7c4664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:00:57.631689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 694/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:00:57.678196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1380e-8904-4feb-9252-9031b03cece3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:00:57.693745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1380e-8904-4feb-9252-9031b03cece3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:00:57.699386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d45b8-97e0-49ab-b758-b8cf667ade17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:00:57.701005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d45b8-97e0-49ab-b758-b8cf667ade17 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:57.701556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d45b8-97e0-49ab-b758-b8cf667ade17 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:57.701556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d45b8-97e0-49ab-b758-b8cf667ade17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:00:57.710501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d45b8-97e0-49ab-b758-b8cf667ade17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:00:57.712209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d45b8-97e0-49ab-b758-b8cf667ade17 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:00:57.716847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:57.723431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 685/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:00:59.998235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce7c1-eda8-4a0f-a4b5-6d6bc5ebcce5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:00:59.998780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce7c1-eda8-4a0f-a4b5-6d6bc5ebcce5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:00:59.998870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce7c1-eda8-4a0f-a4b5-6d6bc5ebcce5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:00.000659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 695/1380] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:00.005893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e938c-dac1-4f78-922c-0bb6b2509463 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:00.006332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e938c-dac1-4f78-922c-0bb6b2509463 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:00.006427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e938c-dac1-4f78-922c-0bb6b2509463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:00.025285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c70e938c-dac1-4f78-922c-0bb6b2509463 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:00.026586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c70e938c-dac1-4f78-922c-0bb6b2509463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:00.040867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 686/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:00.082386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce7c1-eda8-4a0f-a4b5-6d6bc5ebcce5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:00.097589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce7c1-eda8-4a0f-a4b5-6d6bc5ebcce5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:00.103048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338678f-00aa-4272-bdf9-1230ff7db29d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:00.103737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338678f-00aa-4272-bdf9-1230ff7db29d service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:00.104034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338678f-00aa-4272-bdf9-1230ff7db29d service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:00.104321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338678f-00aa-4272-bdf9-1230ff7db29d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:00.113024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338678f-00aa-4272-bdf9-1230ff7db29d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:00.114658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338678f-00aa-4272-bdf9-1230ff7db29d service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:00.125057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 696/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:02.411263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c69e-5c17-469d-b0fd-d78845813d1e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:02.411868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c69e-5c17-469d-b0fd-d78845813d1e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:02.411868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c69e-5c17-469d-b0fd-d78845813d1e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:02.413314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 687/1383] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:02.420027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d682545-51d2-46c6-9749-988a4bef51cb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:02.420590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d682545-51d2-46c6-9749-988a4bef51cb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:02.420590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d682545-51d2-46c6-9749-988a4bef51cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:02.439225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9d682545-51d2-46c6-9749-988a4bef51cb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:02.440421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9d682545-51d2-46c6-9749-988a4bef51cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:02.455550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 697/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:02.490091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40c69e-5c17-469d-b0fd-d78845813d1e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:02.505946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40c69e-5c17-469d-b0fd-d78845813d1e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:02.511559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddbad4-7898-486d-a558-1ed70f523bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:02.512208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbad4-7898-486d-a558-1ed70f523bb7 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:02.512782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbad4-7898-486d-a558-1ed70f523bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:02.513177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbad4-7898-486d-a558-1ed70f523bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:02.522273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddbad4-7898-486d-a558-1ed70f523bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:02.524011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddbad4-7898-486d-a558-1ed70f523bb7 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:02.534883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 688/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:04.851818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b318c-5c2c-4d42-b9b0-b201f60350d8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:04.852391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b318c-5c2c-4d42-b9b0-b201f60350d8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:04.852391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b318c-5c2c-4d42-b9b0-b201f60350d8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:04.853828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 698/1386] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:04.860185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8c1f0-141a-4ac8-a78d-426922a45c6a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:04.860617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8c1f0-141a-4ac8-a78d-426922a45c6a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:04.860761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8c1f0-141a-4ac8-a78d-426922a45c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:04.879361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9d8c1f0-141a-4ac8-a78d-426922a45c6a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:04.880825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9d8c1f0-141a-4ac8-a78d-426922a45c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:04.889622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 689/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:04.935343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b318c-5c2c-4d42-b9b0-b201f60350d8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:04.957763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b318c-5c2c-4d42-b9b0-b201f60350d8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:04.966207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ebb6d-72d8-4cab-87e7-6e9285c6d0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:04.967280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ebb6d-72d8-4cab-87e7-6e9285c6d0c3 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:04.968069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ebb6d-72d8-4cab-87e7-6e9285c6d0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:04.968498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ebb6d-72d8-4cab-87e7-6e9285c6d0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:04.982153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ebb6d-72d8-4cab-87e7-6e9285c6d0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:04.984970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ebb6d-72d8-4cab-87e7-6e9285c6d0c3 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:05.001007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 699/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:07.453460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b2f1a-aefe-4c71-b2e1-62a7103ae0e9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:07.454066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b2f1a-aefe-4c71-b2e1-62a7103ae0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:07.454329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b2f1a-aefe-4c71-b2e1-62a7103ae0e9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:07.456689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 690/1389] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:07.464066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ab1e-bb5d-411c-b315-f8b406908a6f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:07.464499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ab1e-bb5d-411c-b315-f8b406908a6f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:07.464662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ab1e-bb5d-411c-b315-f8b406908a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:07.489929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0ba5ab1e-bb5d-411c-b315-f8b406908a6f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:07.491367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0ba5ab1e-bb5d-411c-b315-f8b406908a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:07.503245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 700/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:01:07.548604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b2f1a-aefe-4c71-b2e1-62a7103ae0e9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:07.571583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b2f1a-aefe-4c71-b2e1-62a7103ae0e9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:07.580657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f384b-ee44-4956-b325-8e61e84afaa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:07.581635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f384b-ee44-4956-b325-8e61e84afaa4 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:07.582164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f384b-ee44-4956-b325-8e61e84afaa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:07.582619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f384b-ee44-4956-b325-8e61e84afaa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:07.595733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f384b-ee44-4956-b325-8e61e84afaa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:07.598233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f384b-ee44-4956-b325-8e61e84afaa4 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:07.612772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 691/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:09.886469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c496-8435-46c4-b49f-e175b5eb03f0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:09.887163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c496-8435-46c4-b49f-e175b5eb03f0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:09.887163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c496-8435-46c4-b49f-e175b5eb03f0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:09.889292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 701/1392] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:09.894731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd0b7a-2693-4277-8e10-0ca4b5e5814b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:09.895303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd0b7a-2693-4277-8e10-0ca4b5e5814b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:09.895415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd0b7a-2693-4277-8e10-0ca4b5e5814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:09.913465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-57dd0b7a-2693-4277-8e10-0ca4b5e5814b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:09.914707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-57dd0b7a-2693-4277-8e10-0ca4b5e5814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:09.922644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 692/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:01:09.967157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c496-8435-46c4-b49f-e175b5eb03f0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:09.981817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c496-8435-46c4-b49f-e175b5eb03f0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:09.987251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60623607-5bb3-40a2-860f-3579046016d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:09.987896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623607-5bb3-40a2-860f-3579046016d8 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:09.988184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623607-5bb3-40a2-860f-3579046016d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:09.988581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623607-5bb3-40a2-860f-3579046016d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:09.998206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623607-5bb3-40a2-860f-3579046016d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:09.999852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623607-5bb3-40a2-860f-3579046016d8 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:10.009518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 702/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:11.768621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a1a0a-00a5-4658-a668-c44bc7f5442d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:11.769215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a1a0a-00a5-4658-a668-c44bc7f5442d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:11.769215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a1a0a-00a5-4658-a668-c44bc7f5442d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:11.770620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 693/1395] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:11.775969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ca02-483c-46c0-a974-3d57a9678569 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:11.776410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ca02-483c-46c0-a974-3d57a9678569 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:11.776546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ca02-483c-46c0-a974-3d57a9678569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:11.782888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=52 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:11.796822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1a83ca02-483c-46c0-a974-3d57a9678569 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:11.798084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a83ca02-483c-46c0-a974-3d57a9678569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:11.806320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 703/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:11.862823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c276c2-1e1d-4bc6-b7d0-bc2bac2a4ade None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:11.863232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c276c2-1e1d-4bc6-b7d0-bc2bac2a4ade None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:11.863586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c276c2-1e1d-4bc6-b7d0-bc2bac2a4ade None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:11.865055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 694/1397] 10.222.0.45 () {54 vars in 962 bytes} [Thu May 26 15:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:11.870150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036bd0e-dd93-4140-8080-ed96f90be7f5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:11.870447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036bd0e-dd93-4140-8080-ed96f90be7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:11.870731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036bd0e-dd93-4140-8080-ed96f90be7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:11.921613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d036bd0e-dd93-4140-8080-ed96f90be7f5 None None] MFA Rules not processed for user `fabeab62b09344859e4479dd227fc61a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:11.922804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d036bd0e-dd93-4140-8080-ed96f90be7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:11.985658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 704/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Thu May 26 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:11.993224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c276c2-1e1d-4bc6-b7d0-bc2bac2a4ade None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:12.004272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c276c2-1e1d-4bc6-b7d0-bc2bac2a4ade None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:12.007891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d05de-02c7-4556-9e94-26d9a4ac014d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:12.008598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d05de-02c7-4556-9e94-26d9a4ac014d service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.008974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d05de-02c7-4556-9e94-26d9a4ac014d service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.009323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d05de-02c7-4556-9e94-26d9a4ac014d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.018329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d05de-02c7-4556-9e94-26d9a4ac014d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:12.019921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d05de-02c7-4556-9e94-26d9a4ac014d service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:12.030462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 695/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:12.290780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb038-30f1-4233-96c4-a08fd60de528 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.291042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb038-30f1-4233-96c4-a08fd60de528 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.291362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb038-30f1-4233-96c4-a08fd60de528 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.298048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 705/1400] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:12.300488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0c6ae-5682-4058-8f2d-5a4bf0bd0033 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.300788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0c6ae-5682-4058-8f2d-5a4bf0bd0033 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.301076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0c6ae-5682-4058-8f2d-5a4bf0bd0033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.324776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6df0c6ae-5682-4058-8f2d-5a4bf0bd0033 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:12.326236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6df0c6ae-5682-4058-8f2d-5a4bf0bd0033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:12.334297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 696/1401] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:12.379435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb038-30f1-4233-96c4-a08fd60de528 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:12.394452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb038-30f1-4233-96c4-a08fd60de528 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:12.399895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994faf95-6504-4401-9b05-85dde8fbaeb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:12.400541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994faf95-6504-4401-9b05-85dde8fbaeb7 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.400824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994faf95-6504-4401-9b05-85dde8fbaeb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.401099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994faf95-6504-4401-9b05-85dde8fbaeb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.410548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994faf95-6504-4401-9b05-85dde8fbaeb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:12.412165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994faf95-6504-4401-9b05-85dde8fbaeb7 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:12.421854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 706/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:12.569902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c14d7-2795-44cd-98e6-779d087c7500 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.570217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c14d7-2795-44cd-98e6-779d087c7500 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.570472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c14d7-2795-44cd-98e6-779d087c7500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.624455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-688c14d7-2795-44cd-98e6-779d087c7500 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:12.625689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-688c14d7-2795-44cd-98e6-779d087c7500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:12.694735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 697/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:12.735916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463576e3-e470-4449-9d2e-34a325281cd4 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.736290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463576e3-e470-4449-9d2e-34a325281cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.736645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463576e3-e470-4449-9d2e-34a325281cd4 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.738239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 707/1404] 10.222.0.45 () {54 vars in 942 bytes} [Thu May 26 15:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:12.744817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405251e5-9e58-4bb6-9b30-a2985f29643e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.745115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405251e5-9e58-4bb6-9b30-a2985f29643e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.745401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405251e5-9e58-4bb6-9b30-a2985f29643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.796942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-405251e5-9e58-4bb6-9b30-a2985f29643e None None] MFA Rules not processed for user `853a5aefa1dc493b9d1b222d3de15156`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:12.798169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-405251e5-9e58-4bb6-9b30-a2985f29643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:12.832806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:12.874794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 698/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Thu May 26 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:12.884158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463576e3-e470-4449-9d2e-34a325281cd4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:12.898525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463576e3-e470-4449-9d2e-34a325281cd4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:12.903520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aac09-2bc5-43fd-9aa7-e3bbbeafae48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:12.904196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aac09-2bc5-43fd-9aa7-e3bbbeafae48 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:12.904485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aac09-2bc5-43fd-9aa7-e3bbbeafae48 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:12.905022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aac09-2bc5-43fd-9aa7-e3bbbeafae48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:12.913302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aac09-2bc5-43fd-9aa7-e3bbbeafae48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:12.914890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aac09-2bc5-43fd-9aa7-e3bbbeafae48 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:12.922920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 708/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:01:14.723857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc47c2e-ceec-40fe-96de-94d31759a316 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:14.724915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc47c2e-ceec-40fe-96de-94d31759a316 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:14.725615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc47c2e-ceec-40fe-96de-94d31759a316 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:14.728485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 699/1407] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:01:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:14.738673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442d965-cfb1-418d-899d-bbcc4e7beef6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:14.739616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442d965-cfb1-418d-899d-bbcc4e7beef6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:14.739907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442d965-cfb1-418d-899d-bbcc4e7beef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:14.765411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0442d965-cfb1-418d-899d-bbcc4e7beef6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:14.766888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0442d965-cfb1-418d-899d-bbcc4e7beef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:14.775632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 709/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:01:14.823294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc47c2e-ceec-40fe-96de-94d31759a316 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:14.839546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc47c2e-ceec-40fe-96de-94d31759a316 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:14.847869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f22160-496d-43f6-9adb-d141f6a2b495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:14.848654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f22160-496d-43f6-9adb-d141f6a2b495 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:14.849049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f22160-496d-43f6-9adb-d141f6a2b495 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:14.849431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f22160-496d-43f6-9adb-d141f6a2b495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:14.859241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f22160-496d-43f6-9adb-d141f6a2b495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:14.860946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f22160-496d-43f6-9adb-d141f6a2b495 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:14.881324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 700/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:24.756949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=55 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:24.867072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=21 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:36.453879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9b5e-fef6-428f-8625-968674488587 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:36.454474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9b5e-fef6-428f-8625-968674488587 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:36.454474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9b5e-fef6-428f-8625-968674488587 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:36.455759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 710/1410] 10.222.0.45 () {54 vars in 918 bytes} [Thu May 26 15:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:36.460915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1e03-8881-4d3b-9196-20ae07a6c6ad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:36.461408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1e03-8881-4d3b-9196-20ae07a6c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:36.461507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1e03-8881-4d3b-9196-20ae07a6c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:36.479784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a55f1e03-8881-4d3b-9196-20ae07a6c6ad None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:36.481488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a55f1e03-8881-4d3b-9196-20ae07a6c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:36.490045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 701/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Thu May 26 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:36.505076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717630e4-ee7b-4e3e-96f4-99351af91371 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:36.505366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717630e4-ee7b-4e3e-96f4-99351af91371 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:36.505645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717630e4-ee7b-4e3e-96f4-99351af91371 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:36.506998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 711/1412] 10.222.0.45 () {54 vars in 918 bytes} [Thu May 26 15:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:36.511542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfb603-d1d4-4bc1-b3d4-8678e058d333 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:36.511837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfb603-d1d4-4bc1-b3d4-8678e058d333 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:36.512109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfb603-d1d4-4bc1-b3d4-8678e058d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:36.529827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-15dfb603-d1d4-4bc1-b3d4-8678e058d333 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:36.531002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-15dfb603-d1d4-4bc1-b3d4-8678e058d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:36.539986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 702/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Thu May 26 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:39.233447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403069-62b0-440c-bae1-f0e066d4aa91 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:39.234023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403069-62b0-440c-bae1-f0e066d4aa91 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:39.234023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403069-62b0-440c-bae1-f0e066d4aa91 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:39.235424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:39.240855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ef213-4025-459b-97bb-d3c90c82b736 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:39.241305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ef213-4025-459b-97bb-d3c90c82b736 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:39.241447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ef213-4025-459b-97bb-d3c90c82b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:39.258877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a56ef213-4025-459b-97bb-d3c90c82b736 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:39.260103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a56ef213-4025-459b-97bb-d3c90c82b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:39.267906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:39.311847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403069-62b0-440c-bae1-f0e066d4aa91 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:39.326608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403069-62b0-440c-bae1-f0e066d4aa91 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:39.332262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8d28-f79d-4d77-a9d9-5083344f2ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:39.332899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8d28-f79d-4d77-a9d9-5083344f2ebc service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:39.333188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8d28-f79d-4d77-a9d9-5083344f2ebc service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:39.333471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8d28-f79d-4d77-a9d9-5083344f2ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:39.342183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e8d28-f79d-4d77-a9d9-5083344f2ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:39.343827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e8d28-f79d-4d77-a9d9-5083344f2ebc service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:39.353221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 713/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:40.347611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305483-cde2-4aec-abb1-0ed187b696ff None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:40.348151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305483-cde2-4aec-abb1-0ed187b696ff None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:40.348151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305483-cde2-4aec-abb1-0ed187b696ff None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:40.349477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:40.354446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76d2d-ba4a-40df-992e-2e7247ddee8c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:40.354849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76d2d-ba4a-40df-992e-2e7247ddee8c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:40.355074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76d2d-ba4a-40df-992e-2e7247ddee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:40.374118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-89c76d2d-ba4a-40df-992e-2e7247ddee8c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:40.375340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-89c76d2d-ba4a-40df-992e-2e7247ddee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:40.383009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:40.560014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305483-cde2-4aec-abb1-0ed187b696ff None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:40.574238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305483-cde2-4aec-abb1-0ed187b696ff None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:40.579690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03491bf6-1794-4a49-a4e0-056cdc58bb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:40.580319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491bf6-1794-4a49-a4e0-056cdc58bb3f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:40.580605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491bf6-1794-4a49-a4e0-056cdc58bb3f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:40.580886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491bf6-1794-4a49-a4e0-056cdc58bb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:40.588981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03491bf6-1794-4a49-a4e0-056cdc58bb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:40.591414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03491bf6-1794-4a49-a4e0-056cdc58bb3f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:40.600870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 705/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:41.526754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ae6f-58c1-4746-baac-a51389a76d9f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:41.527344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ae6f-58c1-4746-baac-a51389a76d9f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:41.527890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ae6f-58c1-4746-baac-a51389a76d9f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:41.529280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:41.534506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44278d4d-65ea-4983-bb64-5fd21656a66e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:41.534912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44278d4d-65ea-4983-bb64-5fd21656a66e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:41.535131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44278d4d-65ea-4983-bb64-5fd21656a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:41.553177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-44278d4d-65ea-4983-bb64-5fd21656a66e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:41.554369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-44278d4d-65ea-4983-bb64-5fd21656a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:41.562735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:41.712089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ae6f-58c1-4746-baac-a51389a76d9f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:41.726514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ae6f-58c1-4746-baac-a51389a76d9f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:41.732401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23680ed-b8a0-4bf8-b0bf-e2d4d3b8cfff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:41.733038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23680ed-b8a0-4bf8-b0bf-e2d4d3b8cfff service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:41.733327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23680ed-b8a0-4bf8-b0bf-e2d4d3b8cfff service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:41.733605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23680ed-b8a0-4bf8-b0bf-e2d4d3b8cfff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:41.741664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23680ed-b8a0-4bf8-b0bf-e2d4d3b8cfff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:41.743283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23680ed-b8a0-4bf8-b0bf-e2d4d3b8cfff service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:41.753183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 716/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:42.679595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811569-0b51-473e-ab2c-482f5fcbf676 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:42.680164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811569-0b51-473e-ab2c-482f5fcbf676 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:42.680164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811569-0b51-473e-ab2c-482f5fcbf676 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:42.681555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:42.687236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6afeee-6cfe-4e4b-91d7-9af25aada556 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:42.687737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6afeee-6cfe-4e4b-91d7-9af25aada556 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:42.687850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6afeee-6cfe-4e4b-91d7-9af25aada556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:42.706599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3c6afeee-6cfe-4e4b-91d7-9af25aada556 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:42.707825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3c6afeee-6cfe-4e4b-91d7-9af25aada556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:42.716330 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:42.866443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811569-0b51-473e-ab2c-482f5fcbf676 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:42.881114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811569-0b51-473e-ab2c-482f5fcbf676 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:42.886453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfae6b-b7f9-44b3-910a-6e3e1c4d9475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:42.887870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfae6b-b7f9-44b3-910a-6e3e1c4d9475 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:42.888152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfae6b-b7f9-44b3-910a-6e3e1c4d9475 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:42.888426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfae6b-b7f9-44b3-910a-6e3e1c4d9475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:42.896401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfae6b-b7f9-44b3-910a-6e3e1c4d9475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:42.897956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfae6b-b7f9-44b3-910a-6e3e1c4d9475 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:42.907701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 708/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:43.810176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cc2d-07da-4395-8950-b05952ef32b3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:43.810774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cc2d-07da-4395-8950-b05952ef32b3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:43.810774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cc2d-07da-4395-8950-b05952ef32b3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:43.812175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:43.817518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d816e-7813-4853-948a-e884a2d8e70c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:43.817948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d816e-7813-4853-948a-e884a2d8e70c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:43.818077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d816e-7813-4853-948a-e884a2d8e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:43.836676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7e3d816e-7813-4853-948a-e884a2d8e70c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:43.837861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e3d816e-7813-4853-948a-e884a2d8e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:43.845610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:43.994149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36cc2d-07da-4395-8950-b05952ef32b3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:44.010927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36cc2d-07da-4395-8950-b05952ef32b3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:44.016360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871582-c837-440d-8cc8-72945e90109a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:44.017003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871582-c837-440d-8cc8-72945e90109a service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:44.017289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871582-c837-440d-8cc8-72945e90109a service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:44.017572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871582-c837-440d-8cc8-72945e90109a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:44.025781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871582-c837-440d-8cc8-72945e90109a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:44.027499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871582-c837-440d-8cc8-72945e90109a service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:44.037366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 719/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:01:44.892197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5c65-049d-4245-b958-edc8df9b719d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:44.892862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5c65-049d-4245-b958-edc8df9b719d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:44.892862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5c65-049d-4245-b958-edc8df9b719d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:44.894128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:44.899149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e471e-71db-4b3f-9d4d-f61796b4967e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:44.899572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e471e-71db-4b3f-9d4d-f61796b4967e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:44.899719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e471e-71db-4b3f-9d4d-f61796b4967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:44.918627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-002e471e-71db-4b3f-9d4d-f61796b4967e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:44.919948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-002e471e-71db-4b3f-9d4d-f61796b4967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:44.927762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:45.077420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5c65-049d-4245-b958-edc8df9b719d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:45.092425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5c65-049d-4245-b958-edc8df9b719d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:45.097761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6862b52-61c7-4c7d-91b6-9e69ca1d0694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:45.098420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862b52-61c7-4c7d-91b6-9e69ca1d0694 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:45.098703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862b52-61c7-4c7d-91b6-9e69ca1d0694 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:45.098978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6862b52-61c7-4c7d-91b6-9e69ca1d0694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:45.107766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6862b52-61c7-4c7d-91b6-9e69ca1d0694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:45.109332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6862b52-61c7-4c7d-91b6-9e69ca1d0694 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:45.118615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 711/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:45.982196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb60929-8522-41a5-8e8b-7d24d539e9eb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:45.982781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb60929-8522-41a5-8e8b-7d24d539e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:45.982781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb60929-8522-41a5-8e8b-7d24d539e9eb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:45.984196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:45.989222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76c38b-d1c2-454a-b154-723b582b4f8c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:45.989613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76c38b-d1c2-454a-b154-723b582b4f8c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:45.989796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76c38b-d1c2-454a-b154-723b582b4f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:46.008692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7f76c38b-d1c2-454a-b154-723b582b4f8c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:46.009931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7f76c38b-d1c2-454a-b154-723b582b4f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:46.017950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:46.173147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb60929-8522-41a5-8e8b-7d24d539e9eb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:46.188284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb60929-8522-41a5-8e8b-7d24d539e9eb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:46.193684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21432447-c398-45d4-b004-53aec1ea2fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:46.194319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21432447-c398-45d4-b004-53aec1ea2fb6 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:46.194608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21432447-c398-45d4-b004-53aec1ea2fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:46.194891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21432447-c398-45d4-b004-53aec1ea2fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:46.203150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21432447-c398-45d4-b004-53aec1ea2fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:46.204747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21432447-c398-45d4-b004-53aec1ea2fb6 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:46.214038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 722/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:47.064174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1bd07-de02-4846-8679-91df900caf75 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:47.064670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1bd07-de02-4846-8679-91df900caf75 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:47.064778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1bd07-de02-4846-8679-91df900caf75 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:47.066112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:47.070920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200fdfa-af01-4d4d-826d-0cdd1a15b7a1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:47.071387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200fdfa-af01-4d4d-826d-0cdd1a15b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:47.071541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200fdfa-af01-4d4d-826d-0cdd1a15b7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:47.091335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a200fdfa-af01-4d4d-826d-0cdd1a15b7a1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:47.092517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a200fdfa-af01-4d4d-826d-0cdd1a15b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:47.100551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:47.254772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1bd07-de02-4846-8679-91df900caf75 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:47.269913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1bd07-de02-4846-8679-91df900caf75 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:47.275329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad261d-521d-4f27-975f-bc41ea875286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:47.275961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad261d-521d-4f27-975f-bc41ea875286 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:47.276246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad261d-521d-4f27-975f-bc41ea875286 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:47.276526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad261d-521d-4f27-975f-bc41ea875286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:47.285110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad261d-521d-4f27-975f-bc41ea875286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:47.286699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad261d-521d-4f27-975f-bc41ea875286 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:47.296613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 714/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:48.156630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8683d-7d58-4b54-83b0-555c01b804e5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:48.157203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8683d-7d58-4b54-83b0-555c01b804e5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:48.157203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8683d-7d58-4b54-83b0-555c01b804e5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:48.158595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:48.163520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d17d4-7da0-45be-b01e-bfa420e0902c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:48.163975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d17d4-7da0-45be-b01e-bfa420e0902c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:48.164081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d17d4-7da0-45be-b01e-bfa420e0902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:48.182449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-961d17d4-7da0-45be-b01e-bfa420e0902c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:48.183813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-961d17d4-7da0-45be-b01e-bfa420e0902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:48.191548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:48.342263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8683d-7d58-4b54-83b0-555c01b804e5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:48.357223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8683d-7d58-4b54-83b0-555c01b804e5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:48.362596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023df75a-2d0e-41a5-8b1f-b356f53d619b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:48.363270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023df75a-2d0e-41a5-8b1f-b356f53d619b service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:48.363557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023df75a-2d0e-41a5-8b1f-b356f53d619b service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:48.363838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023df75a-2d0e-41a5-8b1f-b356f53d619b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:48.372217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023df75a-2d0e-41a5-8b1f-b356f53d619b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:48.373814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023df75a-2d0e-41a5-8b1f-b356f53d619b service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:48.383026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 725/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:50.482424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117a833-2527-472c-87e0-2d1b63b22300 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:50.482894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117a833-2527-472c-87e0-2d1b63b22300 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:50.483010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117a833-2527-472c-87e0-2d1b63b22300 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:50.484412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:50.489834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da861c-73dc-45ea-9c88-e4637ab6d274 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:50.490256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da861c-73dc-45ea-9c88-e4637ab6d274 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:50.490403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da861c-73dc-45ea-9c88-e4637ab6d274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:50.508317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b4da861c-73dc-45ea-9c88-e4637ab6d274 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:50.509541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b4da861c-73dc-45ea-9c88-e4637ab6d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:50.517583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:50.556658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117a833-2527-472c-87e0-2d1b63b22300 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:50.567296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117a833-2527-472c-87e0-2d1b63b22300 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:50.570794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408bae1-ae23-477e-9201-dfd27de08b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:50.571458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408bae1-ae23-477e-9201-dfd27de08b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:50.571745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408bae1-ae23-477e-9201-dfd27de08b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:50.572022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408bae1-ae23-477e-9201-dfd27de08b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:50.580891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408bae1-ae23-477e-9201-dfd27de08b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:50.582303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408bae1-ae23-477e-9201-dfd27de08b3d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:50.592323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 717/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:52.952265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3116-a23d-4e02-94b5-96892424865d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:52.952844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3116-a23d-4e02-94b5-96892424865d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:52.952844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3116-a23d-4e02-94b5-96892424865d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:52.954212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:52.959589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be9890-ecbd-4a72-92d0-0001558cd260 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:52.960024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be9890-ecbd-4a72-92d0-0001558cd260 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:52.960163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be9890-ecbd-4a72-92d0-0001558cd260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:52.977964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a0be9890-ecbd-4a72-92d0-0001558cd260 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:52.979172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0be9890-ecbd-4a72-92d0-0001558cd260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:52.987852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:53.026223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3116-a23d-4e02-94b5-96892424865d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:53.028349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d93e3116-a23d-4e02-94b5-96892424865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:53.043288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3116-a23d-4e02-94b5-96892424865d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:53.047052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2179dd0-a3a8-467e-a3ce-ef15a6e4e953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:53.047726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179dd0-a3a8-467e-a3ce-ef15a6e4e953 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:53.048012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179dd0-a3a8-467e-a3ce-ef15a6e4e953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:53.048291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179dd0-a3a8-467e-a3ce-ef15a6e4e953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:53.057789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2179dd0-a3a8-467e-a3ce-ef15a6e4e953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:53.060006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2179dd0-a3a8-467e-a3ce-ef15a6e4e953 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:53.069542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 728/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:55.587577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45c5ef-7eea-4517-9a3f-c87f020b64af None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:55.588123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45c5ef-7eea-4517-9a3f-c87f020b64af None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:55.588251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45c5ef-7eea-4517-9a3f-c87f020b64af None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:55.590330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 15:01:55.595621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b68ca-8ec1-4c82-a361-d278884a5ed6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:55.596054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b68ca-8ec1-4c82-a361-d278884a5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:55.596182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b68ca-8ec1-4c82-a361-d278884a5ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:55.614676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ad7b68ca-8ec1-4c82-a361-d278884a5ed6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:55.615894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ad7b68ca-8ec1-4c82-a361-d278884a5ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:55.624044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:55.662672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45c5ef-7eea-4517-9a3f-c87f020b64af None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:55.674047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45c5ef-7eea-4517-9a3f-c87f020b64af None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:55.677563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8199e-c2d4-43aa-9e35-86f328375995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:55.678196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8199e-c2d4-43aa-9e35-86f328375995 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:55.678483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8199e-c2d4-43aa-9e35-86f328375995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:55.678761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8199e-c2d4-43aa-9e35-86f328375995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:55.687702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8199e-c2d4-43aa-9e35-86f328375995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:55.689130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8199e-c2d4-43aa-9e35-86f328375995 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:55.698756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 720/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:01:58.050859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5cad0-27a9-44b3-8518-70678c9a44b9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:58.051367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5cad0-27a9-44b3-8518-70678c9a44b9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:58.051488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5cad0-27a9-44b3-8518-70678c9a44b9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:58.052856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:01:58.058939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8b921-684c-4aa0-9676-37f132f7f7e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:58.059392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8b921-684c-4aa0-9676-37f132f7f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:58.059533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8b921-684c-4aa0-9676-37f132f7f7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:58.078579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f4c8b921-684c-4aa0-9676-37f132f7f7e7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:01:58.079822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f4c8b921-684c-4aa0-9676-37f132f7f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:01:58.087642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:01:58.126971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5cad0-27a9-44b3-8518-70678c9a44b9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:01:58.138152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5cad0-27a9-44b3-8518-70678c9a44b9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:01:58.141731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a534e-9925-4e99-8ad5-c3c34495bec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:01:58.142367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a534e-9925-4e99-8ad5-c3c34495bec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:01:58.142649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a534e-9925-4e99-8ad5-c3c34495bec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:01:58.142926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a534e-9925-4e99-8ad5-c3c34495bec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:01:58.152628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a534e-9925-4e99-8ad5-c3c34495bec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:01:58.154073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a534e-9925-4e99-8ad5-c3c34495bec0 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:01:58.163751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 731/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:00.496725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0af852-522b-452f-8504-40880b5aeb49 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:00.497450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0af852-522b-452f-8504-40880b5aeb49 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:00.497708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0af852-522b-452f-8504-40880b5aeb49 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:00.499389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 15:02:00.504965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be095ce-d277-49de-a0a8-013e7e462dfb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:00.505403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be095ce-d277-49de-a0a8-013e7e462dfb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:00.505532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be095ce-d277-49de-a0a8-013e7e462dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:00.523276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5be095ce-d277-49de-a0a8-013e7e462dfb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:00.524505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5be095ce-d277-49de-a0a8-013e7e462dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:00.533850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:00.571889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0af852-522b-452f-8504-40880b5aeb49 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:00.582469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0af852-522b-452f-8504-40880b5aeb49 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:00.585953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d1de-036e-4061-bb94-e514c979b0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:00.586583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d1de-036e-4061-bb94-e514c979b0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:00.586869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d1de-036e-4061-bb94-e514c979b0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:00.587187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d1de-036e-4061-bb94-e514c979b0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:00.596944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d1de-036e-4061-bb94-e514c979b0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:00.598395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d1de-036e-4061-bb94-e514c979b0d2 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:00.608407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 723/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:02.883395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aaed-9321-45e1-823a-bc8c476e5109 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:02.883971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aaed-9321-45e1-823a-bc8c476e5109 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:02.883971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aaed-9321-45e1-823a-bc8c476e5109 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:02.885349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:02.891695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e052e9-d953-4796-b868-edcc3fde476b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:02.892152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e052e9-d953-4796-b868-edcc3fde476b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:02.892251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e052e9-d953-4796-b868-edcc3fde476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:02.910654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-96e052e9-d953-4796-b868-edcc3fde476b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:02.911877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-96e052e9-d953-4796-b868-edcc3fde476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:02.919948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:02.957591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27aaed-9321-45e1-823a-bc8c476e5109 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:02.969301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27aaed-9321-45e1-823a-bc8c476e5109 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:02.972870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b191-ac55-4452-a4dc-6603dd9ddd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:02.973506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b191-ac55-4452-a4dc-6603dd9ddd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:02.973809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b191-ac55-4452-a4dc-6603dd9ddd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:02.974084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b191-ac55-4452-a4dc-6603dd9ddd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:02.982967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b191-ac55-4452-a4dc-6603dd9ddd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:02.984485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b191-ac55-4452-a4dc-6603dd9ddd80 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:02.993871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 734/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:05.332763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd37db-47df-4da8-b0ff-2b16aabdb508 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:05.333302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd37db-47df-4da8-b0ff-2b16aabdb508 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:05.333302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd37db-47df-4da8-b0ff-2b16aabdb508 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:05.334740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:05.340689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837162e-6ec6-4c06-979c-a31f5c663139 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:05.341123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837162e-6ec6-4c06-979c-a31f5c663139 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:05.341261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837162e-6ec6-4c06-979c-a31f5c663139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:05.347315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=70 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:02:05.360883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5837162e-6ec6-4c06-979c-a31f5c663139 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:05.362077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5837162e-6ec6-4c06-979c-a31f5c663139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:05.369962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:05.407664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd37db-47df-4da8-b0ff-2b16aabdb508 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:05.413018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=73 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:02:05.419979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd37db-47df-4da8-b0ff-2b16aabdb508 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:05.423514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0185-f53f-43c5-a060-bc2a0f270502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:05.424144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0185-f53f-43c5-a060-bc2a0f270502 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:05.424427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0185-f53f-43c5-a060-bc2a0f270502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:05.424702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0185-f53f-43c5-a060-bc2a0f270502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:05.433664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0185-f53f-43c5-a060-bc2a0f270502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:05.435113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0185-f53f-43c5-a060-bc2a0f270502 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:05.444365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 726/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:07.722832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a77ad-5d31-4d7e-b859-ae44179cea32 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:07.723452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a77ad-5d31-4d7e-b859-ae44179cea32 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:07.723452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a77ad-5d31-4d7e-b859-ae44179cea32 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:07.724797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:07.730596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508bbfd-63fa-4fed-91d0-97aad561aa2b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:07.731015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508bbfd-63fa-4fed-91d0-97aad561aa2b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:07.731187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508bbfd-63fa-4fed-91d0-97aad561aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:07.748890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4508bbfd-63fa-4fed-91d0-97aad561aa2b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:07.750081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4508bbfd-63fa-4fed-91d0-97aad561aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:07.757801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:07.795122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a77ad-5d31-4d7e-b859-ae44179cea32 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:07.807648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a77ad-5d31-4d7e-b859-ae44179cea32 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:07.811328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ae714-cfdc-40a7-b79c-59a93590e886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:07.811973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ae714-cfdc-40a7-b79c-59a93590e886 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:07.812263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ae714-cfdc-40a7-b79c-59a93590e886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:07.812542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ae714-cfdc-40a7-b79c-59a93590e886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:07.821452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ae714-cfdc-40a7-b79c-59a93590e886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:07.822893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ae714-cfdc-40a7-b79c-59a93590e886 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:07.832342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 737/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:10.095500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6ac5-3c00-4be4-8ed5-c2a146b2f28a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:10.096034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6ac5-3c00-4be4-8ed5-c2a146b2f28a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:10.096133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6ac5-3c00-4be4-8ed5-c2a146b2f28a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:10.097442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:10.102653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6919990-26ad-4886-8b7e-b792ada564d7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:10.103042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6919990-26ad-4886-8b7e-b792ada564d7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:10.103266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6919990-26ad-4886-8b7e-b792ada564d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:10.122825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a6919990-26ad-4886-8b7e-b792ada564d7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:10.124076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a6919990-26ad-4886-8b7e-b792ada564d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:10.132007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:10.168848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c6ac5-3c00-4be4-8ed5-c2a146b2f28a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:10.179620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c6ac5-3c00-4be4-8ed5-c2a146b2f28a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:10.183315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f838e5-2c60-4e7c-9739-b76a64459ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:10.184034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f838e5-2c60-4e7c-9739-b76a64459ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:10.184250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f838e5-2c60-4e7c-9739-b76a64459ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:10.184530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f838e5-2c60-4e7c-9739-b76a64459ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:10.197277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f838e5-2c60-4e7c-9739-b76a64459ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:10.199479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f838e5-2c60-4e7c-9739-b76a64459ae9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:10.209074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 729/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:12.435225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f6c1-8d24-4781-be5c-217591a70679 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:12.435756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f6c1-8d24-4781-be5c-217591a70679 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:12.435756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f6c1-8d24-4781-be5c-217591a70679 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:12.437148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:12.442522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9745-225e-45db-822a-504d5faab85a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:12.442930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9745-225e-45db-822a-504d5faab85a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:12.443107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9745-225e-45db-822a-504d5faab85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:12.461028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9c6f9745-225e-45db-822a-504d5faab85a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:12.462221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9c6f9745-225e-45db-822a-504d5faab85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:12.470761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:12.505984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f6c1-8d24-4781-be5c-217591a70679 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:12.517592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f6c1-8d24-4781-be5c-217591a70679 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:12.521105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a617b5-9665-4d2a-92f7-7d195a497901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:12.521735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a617b5-9665-4d2a-92f7-7d195a497901 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:12.522014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a617b5-9665-4d2a-92f7-7d195a497901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:12.522287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a617b5-9665-4d2a-92f7-7d195a497901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:12.532403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a617b5-9665-4d2a-92f7-7d195a497901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:12.533834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a617b5-9665-4d2a-92f7-7d195a497901 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:12.543568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 740/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:22.455939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=17 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:02:22.538963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=17 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:02:45.877866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6f2a-f9af-4a34-a3eb-547f4f4b9a87 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:45.878523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6f2a-f9af-4a34-a3eb-547f4f4b9a87 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:45.878523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6f2a-f9af-4a34-a3eb-547f4f4b9a87 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:45.879863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 731/1471] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:45.885807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55face-aa33-4438-a314-19edea566e8b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:45.886257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55face-aa33-4438-a314-19edea566e8b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:45.886480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55face-aa33-4438-a314-19edea566e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:45.904763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1f55face-aa33-4438-a314-19edea566e8b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:45.905940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1f55face-aa33-4438-a314-19edea566e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:45.913643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 741/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:45.960672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0b2c-702d-483b-9904-8ce72e81b999 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:45.960964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0b2c-702d-483b-9904-8ce72e81b999 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:45.961246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0b2c-702d-483b-9904-8ce72e81b999 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:45.962623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 732/1473] 10.222.0.45 () {54 vars in 962 bytes} [Thu May 26 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:45.967367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dfdb2-2229-4602-ac9f-b520ba106eb6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:45.967660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dfdb2-2229-4602-ac9f-b520ba106eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:45.967938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dfdb2-2229-4602-ac9f-b520ba106eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:45.985917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e47dfdb2-2229-4602-ac9f-b520ba106eb6 None None] MFA Rules not processed for user `fabeab62b09344859e4479dd227fc61a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:45.987114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e47dfdb2-2229-4602-ac9f-b520ba106eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:45.993430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 742/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Thu May 26 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:46.001262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f0b2c-702d-483b-9904-8ce72e81b999 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:46.012524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f0b2c-702d-483b-9904-8ce72e81b999 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:46.016085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8384487-8d8a-473e-8f7c-dbfa9933ad03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:46.016712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384487-8d8a-473e-8f7c-dbfa9933ad03 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:46.016997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384487-8d8a-473e-8f7c-dbfa9933ad03 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:46.017275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384487-8d8a-473e-8f7c-dbfa9933ad03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:46.026274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384487-8d8a-473e-8f7c-dbfa9933ad03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:46.027742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384487-8d8a-473e-8f7c-dbfa9933ad03 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:46.037922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 733/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:48.345316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef16c-10a8-4c84-9bf9-899bd51552a8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:48.345862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef16c-10a8-4c84-9bf9-899bd51552a8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:48.345862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef16c-10a8-4c84-9bf9-899bd51552a8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:48.347270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 743/1476] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:48.352621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3996d-b7b5-4444-8571-bf32a3a27c01 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:48.353047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3996d-b7b5-4444-8571-bf32a3a27c01 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:48.353234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3996d-b7b5-4444-8571-bf32a3a27c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:48.372620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d6c3996d-b7b5-4444-8571-bf32a3a27c01 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:48.373819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d6c3996d-b7b5-4444-8571-bf32a3a27c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:48.381649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 734/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:48.404929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef16c-10a8-4c84-9bf9-899bd51552a8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:48.417961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef16c-10a8-4c84-9bf9-899bd51552a8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:48.422406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:48.423042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:48.423374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:48.423652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:48.424377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:48.426108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:48.426108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:02:48.426108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:02:48.427285 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3550c-b448-4323-94fb-bb6fb08e837e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:48.446810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 744/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Thu May 26 15:02:48 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:02:50.709919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cb90-b355-40f3-a71b-a151c0c37278 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:50.710498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cb90-b355-40f3-a71b-a151c0c37278 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:50.710498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cb90-b355-40f3-a71b-a151c0c37278 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:50.711892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 735/1479] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:50.718445 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c1f3-bbf1-4e70-b3f1-d9e58880547f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:50.718912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c1f3-bbf1-4e70-b3f1-d9e58880547f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:50.719020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c1f3-bbf1-4e70-b3f1-d9e58880547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:50.736990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-eb38c1f3-bbf1-4e70-b3f1-d9e58880547f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:50.738244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eb38c1f3-bbf1-4e70-b3f1-d9e58880547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:50.747291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 745/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:50.791815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cb90-b355-40f3-a71b-a151c0c37278 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:50.807250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cb90-b355-40f3-a71b-a151c0c37278 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:50.812687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced05e-ca1c-4dea-83ad-85683aa08a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:50.813326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced05e-ca1c-4dea-83ad-85683aa08a9d service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:50.813608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced05e-ca1c-4dea-83ad-85683aa08a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:50.813888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced05e-ca1c-4dea-83ad-85683aa08a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:50.821960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ced05e-ca1c-4dea-83ad-85683aa08a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:50.824139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ced05e-ca1c-4dea-83ad-85683aa08a9d service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:50.833564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 736/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:53.227239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782ebe-99c0-4cb4-953d-5f65240da826 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:53.227817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782ebe-99c0-4cb4-953d-5f65240da826 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:53.227817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782ebe-99c0-4cb4-953d-5f65240da826 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:53.229827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 746/1482] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:53.235056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0fa8-edc8-4dff-adcf-7c1607ac6774 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:53.235535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0fa8-edc8-4dff-adcf-7c1607ac6774 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:53.235645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0fa8-edc8-4dff-adcf-7c1607ac6774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:53.253278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c80c0fa8-edc8-4dff-adcf-7c1607ac6774 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:53.254494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c80c0fa8-edc8-4dff-adcf-7c1607ac6774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:53.262407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 737/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:53.300906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782ebe-99c0-4cb4-953d-5f65240da826 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:53.311818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782ebe-99c0-4cb4-953d-5f65240da826 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:53.315329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ac8d9-a861-4754-9f25-a7192a41729d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:53.315962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ac8d9-a861-4754-9f25-a7192a41729d service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:53.316256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ac8d9-a861-4754-9f25-a7192a41729d service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:53.316535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ac8d9-a861-4754-9f25-a7192a41729d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:53.325912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ac8d9-a861-4754-9f25-a7192a41729d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:53.327383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ac8d9-a861-4754-9f25-a7192a41729d service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:53.336611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 747/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:55.587571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910971-87af-4d86-95ef-300783479e0a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:55.588840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910971-87af-4d86-95ef-300783479e0a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:55.588840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910971-87af-4d86-95ef-300783479e0a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:55.590118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 738/1485] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:55.595482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd371077-2f56-43f9-a638-8bb7a50ea2d1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:55.595930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd371077-2f56-43f9-a638-8bb7a50ea2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:55.596036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd371077-2f56-43f9-a638-8bb7a50ea2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:55.614298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bd371077-2f56-43f9-a638-8bb7a50ea2d1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:55.615527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bd371077-2f56-43f9-a638-8bb7a50ea2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:55.623507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 748/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:55.660968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910971-87af-4d86-95ef-300783479e0a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:55.672520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910971-87af-4d86-95ef-300783479e0a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:55.676069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c13fd8-ceae-41e5-8088-1c0181eab507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:55.676699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c13fd8-ceae-41e5-8088-1c0181eab507 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:55.676987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c13fd8-ceae-41e5-8088-1c0181eab507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:55.677271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c13fd8-ceae-41e5-8088-1c0181eab507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:55.686324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c13fd8-ceae-41e5-8088-1c0181eab507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:55.688878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c13fd8-ceae-41e5-8088-1c0181eab507 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:55.698909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 739/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:02:58.073670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92652e53-cee2-400a-bdda-1ab1a27d1b2b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:58.074250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92652e53-cee2-400a-bdda-1ab1a27d1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:58.074250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92652e53-cee2-400a-bdda-1ab1a27d1b2b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:58.075638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 749/1488] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:02:58.080802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a52ac-f801-4bd7-9aa5-bb03377b486c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:58.081252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a52ac-f801-4bd7-9aa5-bb03377b486c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:58.081361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a52ac-f801-4bd7-9aa5-bb03377b486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:58.099357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a30a52ac-f801-4bd7-9aa5-bb03377b486c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:02:58.100549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a30a52ac-f801-4bd7-9aa5-bb03377b486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:02:58.109032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 740/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:02:58.150132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92652e53-cee2-400a-bdda-1ab1a27d1b2b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:02:58.161341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92652e53-cee2-400a-bdda-1ab1a27d1b2b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:02:58.164870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d170c-469d-4b66-8b06-311e1afb75a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:02:58.165513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d170c-469d-4b66-8b06-311e1afb75a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:02:58.166424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d170c-469d-4b66-8b06-311e1afb75a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:02:58.166943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d170c-469d-4b66-8b06-311e1afb75a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:02:58.176560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d170c-469d-4b66-8b06-311e1afb75a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:02:58.178001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d170c-469d-4b66-8b06-311e1afb75a3 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:02:58.188477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 750/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:03:00.582450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b69f-fd1d-4eb4-a19b-79b4f39ea0c9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:03:00.582984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b69f-fd1d-4eb4-a19b-79b4f39ea0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:03:00.583118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b69f-fd1d-4eb4-a19b-79b4f39ea0c9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:03:00.584423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 741/1491] 10.222.0.45 () {54 vars in 926 bytes} [Thu May 26 15:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:03:00.590323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978a53-4122-4eca-b12f-7b74f74d0a5c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:03:00.590745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978a53-4122-4eca-b12f-7b74f74d0a5c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:03:00.590901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978a53-4122-4eca-b12f-7b74f74d0a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:03:00.608474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fc978a53-4122-4eca-b12f-7b74f74d0a5c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:03:00.609693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fc978a53-4122-4eca-b12f-7b74f74d0a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:03:00.617498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 751/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Thu May 26 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:03:00.656662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b69f-fd1d-4eb4-a19b-79b4f39ea0c9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:03:00.673918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b69f-fd1d-4eb4-a19b-79b4f39ea0c9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:03:00.678252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d256b0-60a1-4503-bb51-74d08149ce61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:03:00.678885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d256b0-60a1-4503-bb51-74d08149ce61 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:03:00.679198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d256b0-60a1-4503-bb51-74d08149ce61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:03:00.679473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d256b0-60a1-4503-bb51-74d08149ce61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:03:00.688819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d256b0-60a1-4503-bb51-74d08149ce61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:03:00.690242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d256b0-60a1-4503-bb51-74d08149ce61 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:03:00.700067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 742/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:03:10.603548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=33 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:03:10.695333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=33 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:04:41.236699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.237296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.237296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.255102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:04:41.256314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:41.264323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 752/1494] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:04:41.273995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.274508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.274640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.293123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:04:41.294238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:41.302020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 743/1495] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:04:41.306483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.316143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315420f-abb3-42c2-8551-98eae8403d84 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.320876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.321525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.321824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.322106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.322835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:04:41.323191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.324216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:41.324216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:04:41.324216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:04:41.325104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.337260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 753/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:04:41.345084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.354708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad635e5-95ad-48cd-bddc-c2504fd4cbc0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.359350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.359992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.360275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.360580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.361296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.363051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:41.363051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:04:41.363051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:04:41.364270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.399681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 744/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:04:41 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:04:41.403917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.415551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2404-266a-479a-bf51-08a01166801b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.471312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.471980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.472273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.472558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.473247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.474365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:41.474365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:04:41.474365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:04:41.476190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.495535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 754/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:04:41 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:04:41.499611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.509881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf4642-1f60-4f7e-af82-30b004eab90b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.514521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.515211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.515501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.515786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.516504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.517508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:41.517508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:04:41.517508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:04:41.518420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.531921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 745/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:04:41.536067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.546789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e929d1-7159-4597-a75c-8582bd1e6541 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.551508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.552223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.552509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.552792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.554484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.556193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:41.556193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:04:41.556193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:04:41.557097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccc885-aeeb-424f-820c-b10d38805e51 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.571140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 755/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:04:41.575279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.585765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4f16e-f940-4ad0-8c92-1e3273665eba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.590282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.591189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.591476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.591756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] PATH_INFO: `/v3/projects/f426044759a349ef92fe85d19dc399fe/users/c6e72c9e5fa140f7bb2c6d65f8f8f370/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.607618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f426044759a349ef92fe85d19dc399fe, user_id=c6e72c9e5fa140f7bb2c6d65f8f8f370, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.608648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:41.608648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:04:41.608648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:04:41.610570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd90f93-83bd-4b4e-bd7c-e3e38a700dda admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.624405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 746/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:04:41 2022] PUT /identity/v3/projects/f426044759a349ef92fe85d19dc399fe/users/c6e72c9e5fa140f7bb2c6d65f8f8f370/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:04:41.636074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419fc4f-25bc-41da-80bf-94de0b3634ac None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.636367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419fc4f-25bc-41da-80bf-94de0b3634ac None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.636648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419fc4f-25bc-41da-80bf-94de0b3634ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.664066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f419fc4f-25bc-41da-80bf-94de0b3634ac None None] MFA Rules not processed for user `c6e72c9e5fa140f7bb2c6d65f8f8f370`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:04:41.665292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f419fc4f-25bc-41da-80bf-94de0b3634ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:41.730541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 756/1502] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:04:41.743473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45d96-009b-4d67-9054-e5f9049ab5b4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.743765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45d96-009b-4d67-9054-e5f9049ab5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.744043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45d96-009b-4d67-9054-e5f9049ab5b4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.745403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 747/1503] 10.222.0.45 () {54 vars in 963 bytes} [Thu May 26 15:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:04:41.750182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c61b40-be86-4ff6-b225-44dbef5b5430 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.750473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c61b40-be86-4ff6-b225-44dbef5b5430 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.750748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c61b40-be86-4ff6-b225-44dbef5b5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.770887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-71c61b40-be86-4ff6-b225-44dbef5b5430 None None] MFA Rules not processed for user `20eba02f87c74008b2fcb4c89c81df34`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:04:41.772251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-71c61b40-be86-4ff6-b225-44dbef5b5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:41.816947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:04:41.825650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 757/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Thu May 26 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:04:41.936548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45d96-009b-4d67-9054-e5f9049ab5b4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:41.948191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45d96-009b-4d67-9054-e5f9049ab5b4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:41.951807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:41.953073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:41.953073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:41.953073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:41.962460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:41.963963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:41.972667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 748/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:04:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:04:42.015655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6841c-1e2a-4900-8d62-25b0bda9982f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:42.015949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6841c-1e2a-4900-8d62-25b0bda9982f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:42.016259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6841c-1e2a-4900-8d62-25b0bda9982f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:42.017562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 758/1506] 10.222.0.45 () {52 vars in 829 bytes} [Thu May 26 15:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:04:42.021044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:42.083708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370390a-28dd-4326-b9bf-a23af14b9f54 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:42.088301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:42.089169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:42.089460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:42.089742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] PATH_INFO: `/v3/users/c6e72c9e5fa140f7bb2c6d65f8f8f370` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:42.090930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e72c9e5fa140f7bb2c6d65f8f8f370)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:42.091979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:42.091979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:04:42.091979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:04:42.093231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:42.158602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e72c9e5fa140f7bb2c6d65f8f8f370'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.159374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e72c9e5fa140f7bb2c6d65f8f8f370'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.171941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e72c9e5fa140f7bb2c6d65f8f8f370'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.172605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e72c9e5fa140f7bb2c6d65f8f8f370'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.182601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e72c9e5fa140f7bb2c6d65f8f8f370'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.199620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:04:42.209603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 749/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:04:42 2022] DELETE /identity/v3/users/c6e72c9e5fa140f7bb2c6d65f8f8f370 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:04:42.214128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:42.214492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:42.214784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:42.232433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:04:42.233677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:42.297991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 759/1508] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:04:42.308591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:42.310010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:42.368446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42dd9-af96-4fd5-ab23-c50fae0624bc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:42.376060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90f5ee-ac76-4d0b-9554-117c64d30d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:42.376722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90f5ee-ac76-4d0b-9554-117c64d30d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:42.377013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90f5ee-ac76-4d0b-9554-117c64d30d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:42.377295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90f5ee-ac76-4d0b-9554-117c64d30d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:42.386406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90f5ee-ac76-4d0b-9554-117c64d30d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:42.387882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90f5ee-ac76-4d0b-9554-117c64d30d55 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:42.397254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 750/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:04:42.745395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:04:42.746923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:04:42.759541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ee2d-066f-4ea8-a221-fef680895826 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:04:42.764716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:04:42.765782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:04:42.766071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:04:42.766353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] PATH_INFO: `/v3/projects/f426044759a349ef92fe85d19dc399fe` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:04:42.767604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f426044759a349ef92fe85d19dc399fe)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:04:42.768635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:42.768635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:04:42.768635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:04:42.769882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:04:42.831492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f426044759a349ef92fe85d19dc399fe', 'request_id': 'req-743bde0c-59af-42bb-928e-0ed6e6892377'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.845479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f426044759a349ef92fe85d19dc399fe', 'request_id': 'req-743bde0c-59af-42bb-928e-0ed6e6892377'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.852895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f426044759a349ef92fe85d19dc399fe', 'request_id': 'req-743bde0c-59af-42bb-928e-0ed6e6892377'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.876810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] The token cache is being invalidate because project f426044759a349ef92fe85d19dc399fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:04:42.877028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.877724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-743bde0c-59af-42bb-928e-0ed6e6892377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:04:42.879647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 760/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:04:42 2022] DELETE /identity/v3/projects/f426044759a349ef92fe85d19dc399fe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:04:52.393045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:04:52.871413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:33.489653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a321193-46ce-4848-962d-0a0f0eaf0a3e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:33.490268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a321193-46ce-4848-962d-0a0f0eaf0a3e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:33.490268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a321193-46ce-4848-962d-0a0f0eaf0a3e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:33.491795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:06:33.497633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63930b1d-49dd-44cd-9aa3-de379916ee01 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:33.498554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63930b1d-49dd-44cd-9aa3-de379916ee01 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:33.498554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63930b1d-49dd-44cd-9aa3-de379916ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:33.520622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-63930b1d-49dd-44cd-9aa3-de379916ee01 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:33.521911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-63930b1d-49dd-44cd-9aa3-de379916ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:33.593706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:33.773280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a321193-46ce-4848-962d-0a0f0eaf0a3e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:33.774990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6a321193-46ce-4848-962d-0a0f0eaf0a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:33.859438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a321193-46ce-4848-962d-0a0f0eaf0a3e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:33.865974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e380c4-0b71-4629-a240-bdf3de7c0bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:33.866667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e380c4-0b71-4629-a240-bdf3de7c0bc8 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:33.866949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e380c4-0b71-4629-a240-bdf3de7c0bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:33.867335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e380c4-0b71-4629-a240-bdf3de7c0bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:33.876508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e380c4-0b71-4629-a240-bdf3de7c0bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:33.878156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e380c4-0b71-4629-a240-bdf3de7c0bc8 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:33.888829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 752/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:34.709698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826ed4-7e90-4a56-a077-e5140e6f8dc2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:34.710280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826ed4-7e90-4a56-a077-e5140e6f8dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:34.710280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826ed4-7e90-4a56-a077-e5140e6f8dc2 None None] PATH_INFO: `/v3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:34.711615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 762/1514] 10.222.0.71 () {54 vars in 925 bytes} [Thu May 26 15:06:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:06:34.718346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528f2c-490e-4dd4-b067-9e78c1a8497e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:34.718862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528f2c-490e-4dd4-b067-9e78c1a8497e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:34.718965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528f2c-490e-4dd4-b067-9e78c1a8497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:34.738339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-25528f2c-490e-4dd4-b067-9e78c1a8497e None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:34.739631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25528f2c-490e-4dd4-b067-9e78c1a8497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:34.810620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 753/1515] 10.222.0.71 () {58 vars in 1015 bytes} [Thu May 26 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:06:34.811892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206676c-1054-42cd-a6fa-568f149dfc50 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:34.812197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206676c-1054-42cd-a6fa-568f149dfc50 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:34.812481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206676c-1054-42cd-a6fa-568f149dfc50 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:34.813963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 763/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 15:06:34.820936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179e8c5-dc8e-4085-8169-20953faf9288 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:34.821205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179e8c5-dc8e-4085-8169-20953faf9288 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:34.821489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179e8c5-dc8e-4085-8169-20953faf9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:34.841222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8179e8c5-dc8e-4085-8169-20953faf9288 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:34.842466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8179e8c5-dc8e-4085-8169-20953faf9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:34.850834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 754/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:35.007030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206676c-1054-42cd-a6fa-568f149dfc50 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:35.024809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206676c-1054-42cd-a6fa-568f149dfc50 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:35.030824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11cb7-215c-4a97-8967-93782e996039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:35.031534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11cb7-215c-4a97-8967-93782e996039 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:35.031829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11cb7-215c-4a97-8967-93782e996039 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:35.032147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11cb7-215c-4a97-8967-93782e996039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:35.042632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11cb7-215c-4a97-8967-93782e996039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:35.044300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11cb7-215c-4a97-8967-93782e996039 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:35.061969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 764/1518] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:38.862522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51f187-4b98-4448-810d-94fe4868b8c3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:38.863077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51f187-4b98-4448-810d-94fe4868b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:38.863826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51f187-4b98-4448-810d-94fe4868b8c3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:38.865238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 755/1519] 10.222.0.45 () {54 vars in 960 bytes} [Thu May 26 15:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:06:38.870693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2016-f29d-4edf-a11e-7b1caab47066 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:38.871168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2016-f29d-4edf-a11e-7b1caab47066 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:38.871273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2016-f29d-4edf-a11e-7b1caab47066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:38.890867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e54b2016-f29d-4edf-a11e-7b1caab47066 None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:38.892142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e54b2016-f29d-4edf-a11e-7b1caab47066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:38.902565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 765/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Thu May 26 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:38.911049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51f187-4b98-4448-810d-94fe4868b8c3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:38.924743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51f187-4b98-4448-810d-94fe4868b8c3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:38.930357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07df-1a48-4019-b9ed-35d52a264b66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:38.931007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07df-1a48-4019-b9ed-35d52a264b66 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:38.931316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07df-1a48-4019-b9ed-35d52a264b66 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:38.931593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07df-1a48-4019-b9ed-35d52a264b66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:38.940414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df07df-1a48-4019-b9ed-35d52a264b66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:38.943210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df07df-1a48-4019-b9ed-35d52a264b66 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:38.953715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 756/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:46.351738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100a23-1d3d-49d9-b3b5-87a11f447947 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:46.352387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100a23-1d3d-49d9-b3b5-87a11f447947 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:46.352387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0100a23-1d3d-49d9-b3b5-87a11f447947 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:46.353638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 15:06:46.358462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993313f-1cb8-4ef9-8b9d-2386007692a3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:46.358890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993313f-1cb8-4ef9-8b9d-2386007692a3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:46.359030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993313f-1cb8-4ef9-8b9d-2386007692a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:46.380317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c993313f-1cb8-4ef9-8b9d-2386007692a3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:46.381545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c993313f-1cb8-4ef9-8b9d-2386007692a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:46.389560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:46.547976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100a23-1d3d-49d9-b3b5-87a11f447947 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:46.563843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0100a23-1d3d-49d9-b3b5-87a11f447947 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:46.569491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44dd89d-57b8-47ff-8883-a076771b8418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:46.570131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dd89d-57b8-47ff-8883-a076771b8418 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:46.570420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dd89d-57b8-47ff-8883-a076771b8418 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:46.570701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dd89d-57b8-47ff-8883-a076771b8418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:46.578842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44dd89d-57b8-47ff-8883-a076771b8418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:46.580520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44dd89d-57b8-47ff-8883-a076771b8418 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:46.590957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 767/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:47.471315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a093a6-c2a1-4311-9ac7-19d7d7435322 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:47.471803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a093a6-c2a1-4311-9ac7-19d7d7435322 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:47.471955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a093a6-c2a1-4311-9ac7-19d7d7435322 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:47.473870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 15:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:06:47.479261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec465-a8ce-4ee0-b2e4-822a9e03873a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:47.479730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec465-a8ce-4ee0-b2e4-822a9e03873a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:47.479844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec465-a8ce-4ee0-b2e4-822a9e03873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:47.506654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0baec465-a8ce-4ee0-b2e4-822a9e03873a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:47.508883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0baec465-a8ce-4ee0-b2e4-822a9e03873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:47.520497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:47.675847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a093a6-c2a1-4311-9ac7-19d7d7435322 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:47.690331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a093a6-c2a1-4311-9ac7-19d7d7435322 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:47.696276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a025c-6ef2-4b3a-94ac-ce5f6301f4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:47.696915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a025c-6ef2-4b3a-94ac-ce5f6301f4b7 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:47.697201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a025c-6ef2-4b3a-94ac-ce5f6301f4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:47.697479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a025c-6ef2-4b3a-94ac-ce5f6301f4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:47.707384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a025c-6ef2-4b3a-94ac-ce5f6301f4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:47.708990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a025c-6ef2-4b3a-94ac-ce5f6301f4b7 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:47.718878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 759/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:52.250864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7502a-eab2-4728-9f0a-1129a5453734 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:52.251460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7502a-eab2-4728-9f0a-1129a5453734 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:52.251460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7502a-eab2-4728-9f0a-1129a5453734 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:52.253372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:06:52.259367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06044f-0263-4a8f-bf0e-7e026896a9e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:52.259913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06044f-0263-4a8f-bf0e-7e026896a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:52.259913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06044f-0263-4a8f-bf0e-7e026896a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:52.279357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9b06044f-0263-4a8f-bf0e-7e026896a9e7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:52.280574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9b06044f-0263-4a8f-bf0e-7e026896a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:52.288988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:52.327208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7502a-eab2-4728-9f0a-1129a5453734 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:52.329005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-51b7502a-eab2-4728-9f0a-1129a5453734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:52.387711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7502a-eab2-4728-9f0a-1129a5453734 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:52.391375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602280e8-a352-4ea1-a031-44285356e970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:52.392032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602280e8-a352-4ea1-a031-44285356e970 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:52.392316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602280e8-a352-4ea1-a031-44285356e970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:52.392592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602280e8-a352-4ea1-a031-44285356e970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:52.403880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602280e8-a352-4ea1-a031-44285356e970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:52.405351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602280e8-a352-4ea1-a031-44285356e970 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:52.415612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 770/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:54.671553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75494009-2461-4465-8531-ebbb335b45e3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:54.672133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75494009-2461-4465-8531-ebbb335b45e3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:54.672133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75494009-2461-4465-8531-ebbb335b45e3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:54.673501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 15:06:54.680037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c5349-a932-4c20-ace3-14218fbd2858 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:54.680551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c5349-a932-4c20-ace3-14218fbd2858 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:54.680667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c5349-a932-4c20-ace3-14218fbd2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:54.701422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-853c5349-a932-4c20-ace3-14218fbd2858 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:54.702765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-853c5349-a932-4c20-ace3-14218fbd2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:54.711396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:54.747794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75494009-2461-4465-8531-ebbb335b45e3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:54.760726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75494009-2461-4465-8531-ebbb335b45e3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:54.764283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d7d76-aa4c-46e4-99c3-2f2da91438c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:54.764924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7d76-aa4c-46e4-99c3-2f2da91438c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:54.765200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7d76-aa4c-46e4-99c3-2f2da91438c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:54.765472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7d76-aa4c-46e4-99c3-2f2da91438c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:54.776283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d7d76-aa4c-46e4-99c3-2f2da91438c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:54.777713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d7d76-aa4c-46e4-99c3-2f2da91438c2 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:54.790877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 762/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:06:58.968329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c77ddb-eb60-48f7-803f-edf8ccee5aec None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:58.968866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c77ddb-eb60-48f7-803f-edf8ccee5aec None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:58.968866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c77ddb-eb60-48f7-803f-edf8ccee5aec None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:58.970206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:06:58.975936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119880-eaa0-410f-9e64-f8fc58b7a708 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:58.976446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119880-eaa0-410f-9e64-f8fc58b7a708 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:58.976553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119880-eaa0-410f-9e64-f8fc58b7a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:58.994580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f119880-eaa0-410f-9e64-f8fc58b7a708 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:06:58.995922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f119880-eaa0-410f-9e64-f8fc58b7a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:59.005348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:06:59.289058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c77ddb-eb60-48f7-803f-edf8ccee5aec None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:06:59.290765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8c77ddb-eb60-48f7-803f-edf8ccee5aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:06:59.352610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c77ddb-eb60-48f7-803f-edf8ccee5aec None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:06:59.356164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb7118-bfd6-4fd5-88a8-7db222d1eef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:06:59.356812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb7118-bfd6-4fd5-88a8-7db222d1eef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:06:59.357100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb7118-bfd6-4fd5-88a8-7db222d1eef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:06:59.357375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb7118-bfd6-4fd5-88a8-7db222d1eef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:06:59.367339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb7118-bfd6-4fd5-88a8-7db222d1eef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:06:59.368799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb7118-bfd6-4fd5-88a8-7db222d1eef5 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:06:59.373936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:59.379806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 773/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:07:01.708167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80542c82-ab98-4991-853f-4742f6981d01 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:07:01.708780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80542c82-ab98-4991-853f-4742f6981d01 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:07:01.708780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80542c82-ab98-4991-853f-4742f6981d01 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:07:01.710125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 15:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:07:01.716519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ad61-84ae-4cce-9558-5e9f9dc93d3d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:07:01.716519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ad61-84ae-4cce-9558-5e9f9dc93d3d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:07:01.716519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ad61-84ae-4cce-9558-5e9f9dc93d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:07:01.734945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8320ad61-84ae-4cce-9558-5e9f9dc93d3d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:07:01.736200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8320ad61-84ae-4cce-9558-5e9f9dc93d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:07:01.744209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:07:02.018092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80542c82-ab98-4991-853f-4742f6981d01 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:07:02.020929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-80542c82-ab98-4991-853f-4742f6981d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:07:02.034566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80542c82-ab98-4991-853f-4742f6981d01 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:07:02.038168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e64a3a-aeed-4ba4-bef8-956043a7aced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:07:02.038822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64a3a-aeed-4ba4-bef8-956043a7aced service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:07:02.039128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64a3a-aeed-4ba4-bef8-956043a7aced service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:07:02.039410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64a3a-aeed-4ba4-bef8-956043a7aced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:07:02.049314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e64a3a-aeed-4ba4-bef8-956043a7aced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:07:02.051126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e64a3a-aeed-4ba4-bef8-956043a7aced service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:07:02.061100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 765/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:07:11.729590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:07:12.056653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:35.734073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f370-623f-45b1-a5c6-e054c3fc05be None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:35.735171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f370-623f-45b1-a5c6-e054c3fc05be None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:35.735716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f370-623f-45b1-a5c6-e054c3fc05be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:35.776122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a202f370-623f-45b1-a5c6-e054c3fc05be None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:35.777352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a202f370-623f-45b1-a5c6-e054c3fc05be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:35.795929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 775/1540] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:35.806968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:35.808150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:35.808658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:35.823497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9362e-d4bb-4495-aa18-ad7da4b514d9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:35.824074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9362e-d4bb-4495-aa18-ad7da4b514d9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:35.824821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9362e-d4bb-4495-aa18-ad7da4b514d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:35.844321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:35.846282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:35.856208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-10c9362e-d4bb-4495-aa18-ad7da4b514d9 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:35.857983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-10c9362e-d4bb-4495-aa18-ad7da4b514d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:35.872254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 766/1541] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:35.873576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 776/1542] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:35.881082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:35.898181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e854ed-fe34-48e8-81ce-ff2eac0084d4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:35.903938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92706-8cbd-4dab-a90c-4913c3c35cc5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:35.904621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92706-8cbd-4dab-a90c-4913c3c35cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:35.905131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92706-8cbd-4dab-a90c-4913c3c35cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:35.923237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:35.924387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:35.924673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:35.924951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:35.925757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:35.926071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:35.940979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:35.940979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:08:35.940979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:08:35.942018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65350b-020a-44d2-9677-b925327a1f43 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.016351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3bb92706-8cbd-4dab-a90c-4913c3c35cc5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.018175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3bb92706-8cbd-4dab-a90c-4913c3c35cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.050079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 767/1543] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:08:36.052115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dca8-24b5-4d14-a3fa-02d58eafb056 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.052603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dca8-24b5-4d14-a3fa-02d58eafb056 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.053109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dca8-24b5-4d14-a3fa-02d58eafb056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.071413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 777/1544] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.071413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6420-2313-4844-8c26-c409b5122629 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.071413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6420-2313-4844-8c26-c409b5122629 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.071413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6420-2313-4844-8c26-c409b5122629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.080621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c109dca8-24b5-4d14-a3fa-02d58eafb056 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.081865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c109dca8-24b5-4d14-a3fa-02d58eafb056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.100882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 768/1545] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.102293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.102592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.102874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.114744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-45af6420-2313-4844-8c26-c409b5122629 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.115989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45af6420-2313-4844-8c26-c409b5122629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.137781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.141672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 778/1546] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.142652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6420-2313-4844-8c26-c409b5122629 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.143191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.153048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 769/1547] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.154571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.173803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6420-2313-4844-8c26-c409b5122629 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.176647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4b0bc-9587-4e4e-bd60-c512f0e9fa6a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.182807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.183038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.183527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.183719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.183839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.183930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.184103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.184207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.184785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.184956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:36.185240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.185824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:36.185824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:08:36.185824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:08:36.186901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d38d7b-af3e-4ddb-8f6f-7e44c9057f12 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.187038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248c874-28ef-468c-a5a6-3988b209c508 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.206124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 770/1548] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:36.207907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e50b3c-af2d-4bfb-a6b1-a9af9cbd4558 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.208206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e50b3c-af2d-4bfb-a6b1-a9af9cbd4558 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.208516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e50b3c-af2d-4bfb-a6b1-a9af9cbd4558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.223854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 779/1549] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.225202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80162e-1441-4197-bfbb-ea41697958ef None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.226207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80162e-1441-4197-bfbb-ea41697958ef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.226504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80162e-1441-4197-bfbb-ea41697958ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.229764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-04e50b3c-af2d-4bfb-a6b1-a9af9cbd4558 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.230973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04e50b3c-af2d-4bfb-a6b1-a9af9cbd4558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.246702 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4f80162e-1441-4197-bfbb-ea41697958ef None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.248027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4f80162e-1441-4197-bfbb-ea41697958ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.301059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 771/1550] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.302297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd036-2e03-4bd5-ba89-e168b9a99ce7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.302588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd036-2e03-4bd5-ba89-e168b9a99ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.302866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd036-2e03-4bd5-ba89-e168b9a99ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.321931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-64bcd036-2e03-4bd5-ba89-e168b9a99ce7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.322577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 780/1551] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.323211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-64bcd036-2e03-4bd5-ba89-e168b9a99ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.323947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1a3b2-97ca-4a4a-a1e2-593fa32e059a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.324250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1a3b2-97ca-4a4a-a1e2-593fa32e059a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.324737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1a3b2-97ca-4a4a-a1e2-593fa32e059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.342911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 772/1552] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.344448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.344820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.345081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.348773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e2f1a3b2-97ca-4a4a-a1e2-593fa32e059a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.350020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e2f1a3b2-97ca-4a4a-a1e2-593fa32e059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.363454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 781/1553] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.364601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.364893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.365177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.369974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.372638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.395023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 773/1554] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.395023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.395554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.395554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.403986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 782/1555] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.404588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.409366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11767-1307-4b4c-866e-5eb29b5df5cc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.415796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b877937-2b5c-4113-83bb-1db3dd8b632a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.416636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ca11-1e17-42da-a9df-38f98d65e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.417339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ca11-1e17-42da-a9df-38f98d65e2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.417761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ca11-1e17-42da-a9df-38f98d65e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.417997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ca11-1e17-42da-a9df-38f98d65e2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.418699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ca11-1e17-42da-a9df-38f98d65e2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.420924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.421132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ca11-1e17-42da-a9df-38f98d65e2f6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.421473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.421828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.422105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.425198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.427270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.455621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 783/1556] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.457206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.464389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 774/1557] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.465797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.466078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.466355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.475957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1423c-c1dd-452d-8bfe-222e22c686da admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.503106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.504410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.561573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.562570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.563062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.563856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.564924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:36.565563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.568392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.590484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 784/1558] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:36.590484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.597401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9a573-7f07-4910-a428-731484f792a4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.603215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.603890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.604187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.604468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.605234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:36.605558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.607249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2362b9-4a32-4a9e-a7fa-98d6a72107b9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.612590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 775/1559] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.612590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.626905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 785/1560] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:36.626905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.627296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d317a-a811-4b3d-9f84-6a8878cec205 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.627401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.627401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.632298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.633087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.633799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.634153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.634822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:36.636011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.636829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c365b-613e-4737-8d75-e384bf455596 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.637286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:36.647469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.649204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.658036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 776/1561] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:36.658036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.658036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.658036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.665124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 786/1562] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.666137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.677427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:36.677985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea813d-e901-489b-b9c4-ca58706a3169 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.683356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.684058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.684336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.685632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.685750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:36.686389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.687188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:36.688118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.696721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 777/1563] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:36.700215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.707260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 787/1564] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:36.707260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.714242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0d09a-9aac-4295-a983-3c36fd471bc1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.717544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386d00-4e10-40f0-88ed-487e6766461e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.720982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.721744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.722102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.722468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.723190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.723509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.723880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.724165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.724683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.724924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:36.724924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:08:36.724924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:08:36.725149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.725982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.727543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.760257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 778/1565] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/users => generated 294 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.761110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.769815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 788/1566] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.770768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.774141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef6d12-42c9-43e3-8a58-84264d96bcc3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.844436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.846045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.846209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.846431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.847145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:36.847453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.849095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.849248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2a6f6-c2ba-43dc-a2d0-1e2c6b09933e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.854490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.855313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.855721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.856002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.857179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.859671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.871061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 779/1567] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:36.871061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.879714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c92c3-73f9-494b-9924-86c79999dd4e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.885331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:36.886044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:36.886332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:36.886624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:36.887353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:36.892318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 789/1568] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.892318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.892742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:36.920657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 780/1569] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:36 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:36.921611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:36.971444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f58d8a-f2ca-4549-8e89-ccbcb91d4b3b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:36.997147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85939704-cf09-4bd4-a023-b2d1165dbf08 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.004239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.004239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.004239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.004755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.005354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:37.005666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.007331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.025244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 781/1570] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:37.025244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.038377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.038991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580af06-1b4b-43a2-9109-61dd91a7bf7f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.045912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.046047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.046174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.046174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.046401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.046501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.046858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.047193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.047320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.048011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:37.048720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.050943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.053483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.066741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 782/1571] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.067744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.073838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 790/1572] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:37.073838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.081270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e15c-6048-4695-8c3b-1775dd4123a8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.081527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fb43f-e9fa-43ee-9cf9-9a0f116df02b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.086893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.087637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.087952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.088081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.088484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.089157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.089282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.089574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.089922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.090855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.092102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.092562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.105888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 783/1573] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.106670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.121634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 791/1574] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.121634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.121936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ca76-b483-4f86-a2fd-1c68e9d04458 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.126654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.127580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.128011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.128449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.129464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.130389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e6b27-9bb5-4c36-83fd-d96b193e5713 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.132142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.135797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.136487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.136780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.137063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.137916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.139959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.169798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 792/1575] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.170013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 784/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.170135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.170323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.174219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.181891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79484159-a691-49d3-9856-c173e5d46d0b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.247023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67282e-b1c0-4905-9438-55e304ad114f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.255726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.256390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.256530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.256706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.256992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.257112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.257372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.257654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.257758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.258350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.260591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.260734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.282454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 793/1577] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.284225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.296668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94939aa-725b-42e9-82dd-b4b569d1cb13 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.298886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 785/1578] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.299794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.368570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caa348-96bf-43f4-b828-4b37c0873ebe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.373170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.373370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.374022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.374133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.374312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.374443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.374592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.374701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] PATH_INFO: `/v3/projects/c05d2d0c2652419a97189c0a5d55892c/users/fb6aefbbf3a143e394e3b568371c060f/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.375332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.379467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.391339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05d2d0c2652419a97189c0a5d55892c, user_id=fb6aefbbf3a143e394e3b568371c060f, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.393227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:37.393227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:08:37.393227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:08:37.395458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.410813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 794/1579] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:37 2022] PUT /identity/v3/projects/c05d2d0c2652419a97189c0a5d55892c/users/fb6aefbbf3a143e394e3b568371c060f/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:37.411823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.426795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 786/1580] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.428013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.444559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.484663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cd112-adc3-4fa3-a22e-506a3b593f52 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.495452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb53201-5093-493b-9c16-e8d2c3ba3139 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.500138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.500805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.501672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.501946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.502673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.504420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.514786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 787/1581] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.515600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.525854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8d2a3-721b-49b8-aaa3-f1c03aac1081 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.531224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.531882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.532163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.532557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.533179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.535079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.543774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.554414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.555125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.555421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.555707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.556454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.560472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 788/1582] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.560472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.560744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.576657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96dc6f-c77b-4efb-bedf-9900c3539f68 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.577693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 795/1583] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.579171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.584806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.585640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.585933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.586217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.587288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.589767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.592006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db27a1d-0636-4c3b-a838-6648554e6185 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.597284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460f020-b63a-45dd-b92a-70ef708cdbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.597975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460f020-b63a-45dd-b92a-70ef708cdbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.598265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460f020-b63a-45dd-b92a-70ef708cdbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.598551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460f020-b63a-45dd-b92a-70ef708cdbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.599319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460f020-b63a-45dd-b92a-70ef708cdbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.600965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460f020-b63a-45dd-b92a-70ef708cdbf6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.602029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 789/1584] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.602896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.615189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 796/1585] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.615377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013a98e-0561-4fa0-b425-e05a1b0e366c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.615519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.615519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.615519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.618737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.619371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.619665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.620008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.621551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.622655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.647333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] MFA Rules not processed for user `fb6aefbbf3a143e394e3b568371c060f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:37.649292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:37.654225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 790/1586] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.655615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.665779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f0f7-af60-4375-b7e5-d330b575b043 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.677081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.677817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.678121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.678408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.679152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.681209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.701922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 791/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:37.704146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.715136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d01dd-0f3b-4eb9-9be4-75450821d937 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.720618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.720987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 797/1588] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:37.731690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.731690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.731923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.732020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.732020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.732020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.732619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9776a-e602-4b30-8ca3-e3aa5a74baa2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.736200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 792/1589] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.737248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.741321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.742388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.742892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.743403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.744340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.746342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.750420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdea487-4045-42d8-a1a5-bcdc1035bd1a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.755699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.756751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.757144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.760637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 798/1590] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.760794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] PATH_INFO: `/v3/projects/b9de893c8bbd47b59e136fe46e791a52/users/1748648695bb46a9b2c7912c48e95bbd/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.760911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.773983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251767-d11c-4dcd-b66f-eb1f6d724db3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.778850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9de893c8bbd47b59e136fe46e791a52, user_id=1748648695bb46a9b2c7912c48e95bbd, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.778978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.779585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.779871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.780148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.780869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.781652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.782615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.794490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 799/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.795228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.796769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 793/1592] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:37 2022] PUT /identity/v3/projects/b9de893c8bbd47b59e136fe46e791a52/users/1748648695bb46a9b2c7912c48e95bbd/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:37.797692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.809200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfdb0d-e665-4fde-86b2-1a87cab76d0d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.834333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.864758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e73f94-64fa-4563-b651-c2504931d7ba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.868152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.868883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.869116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.869394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.869620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.870121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.870285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.870571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.870850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.871604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.871771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.873195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.882238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 800/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.883061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.886741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 794/1594] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.887616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.893142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe500f0f-3abc-4a8b-9d06-dac81446a7c8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.897797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee525bb-4841-46f5-bbc3-87e28d9a92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.897966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b3a0-470a-49ed-b9bf-587eaf719291 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.898478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee525bb-4841-46f5-bbc3-87e28d9a92f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.898792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee525bb-4841-46f5-bbc3-87e28d9a92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.899134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee525bb-4841-46f5-bbc3-87e28d9a92f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.900217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee525bb-4841-46f5-bbc3-87e28d9a92f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.901811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee525bb-4841-46f5-bbc3-87e28d9a92f0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.902970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.903895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.904174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.904454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] PATH_INFO: `/v3/projects/4f0c728c3f0f4831ac6839d00bf0d7fc/users/7889e26696384400b300f4b8572ef515/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.913371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 801/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.914779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c208c-3330-4ceb-8220-967a5975a011 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.915108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c208c-3330-4ceb-8220-967a5975a011 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.915406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c208c-3330-4ceb-8220-967a5975a011 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.917089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 802/1596] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 15:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:08:37.917852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c208c-3330-4ceb-8220-967a5975a011 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.926471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0c728c3f0f4831ac6839d00bf0d7fc, user_id=7889e26696384400b300f4b8572ef515, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.929498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.930834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c208c-3330-4ceb-8220-967a5975a011 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:37.936095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849d295-5674-4eb6-b61e-ccee879ed5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:37.936875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d295-5674-4eb6-b61e-ccee879ed5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.937080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d295-5674-4eb6-b61e-ccee879ed5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.937362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d295-5674-4eb6-b61e-ccee879ed5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.938127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849d295-5674-4eb6-b61e-ccee879ed5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:37.940311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849d295-5674-4eb6-b61e-ccee879ed5f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:37.944645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 795/1597] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:37 2022] PUT /identity/v3/projects/4f0c728c3f0f4831ac6839d00bf0d7fc/users/7889e26696384400b300f4b8572ef515/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:37.945631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:37.954568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 803/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:37.954568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:37.954568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:37.954568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:37.971624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:37.972939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:37.997614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:38.016619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1466e3-c041-4ce2-89f9-de69371609e9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.022792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.024107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.024785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.025307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] PATH_INFO: `/v3/projects/85ea8fbf32d748a8ad70996a9fa12843/users/9a671e0538ca45bbb44c298f1aa13a37/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.042192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 804/1599] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:38.043286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.044988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ea8fbf32d748a8ad70996a9fa12843, user_id=9a671e0538ca45bbb44c298f1aa13a37, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.048628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.055840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f5b28-e7a4-4b70-8d7c-51f04f09ec0a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.061459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.062366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.062653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.062931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] PATH_INFO: `/v3/projects/39490fef872043d1bfef791dd0bbb5a5/users/3b7a1284bc044e51923c72a9f8f41d95/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.065696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 796/1600] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:37 2022] PUT /identity/v3/projects/85ea8fbf32d748a8ad70996a9fa12843/users/9a671e0538ca45bbb44c298f1aa13a37/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:38.069607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.083779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=39490fef872043d1bfef791dd0bbb5a5, user_id=3b7a1284bc044e51923c72a9f8f41d95, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.086545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.100754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 805/1601] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:38 2022] PUT /identity/v3/projects/39490fef872043d1bfef791dd0bbb5a5/users/3b7a1284bc044e51923c72a9f8f41d95/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:38.101746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.134253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766bd1-de63-4498-a184-359d25dd8242 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.166690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda42e-ba0e-49a1-a005-608342905cdf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.171425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44530b0-ae58-499f-9d19-9b4c2e2df019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.172098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44530b0-ae58-499f-9d19-9b4c2e2df019 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.172384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44530b0-ae58-499f-9d19-9b4c2e2df019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.172665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44530b0-ae58-499f-9d19-9b4c2e2df019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.174678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44530b0-ae58-499f-9d19-9b4c2e2df019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.176330 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44530b0-ae58-499f-9d19-9b4c2e2df019 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.186322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 806/1602] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:38.187849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.188176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.188483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.195226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.195937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.196228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.196508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.197238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.198893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.207409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:38.208658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:38.209657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 797/1603] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:38.210461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.217776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:38.221316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e4b9-a199-4f5c-a572-1177ef4a757c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.225960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a580a61-7932-4e45-8b2e-ab8981515fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.226849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580a61-7932-4e45-8b2e-ab8981515fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.227162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580a61-7932-4e45-8b2e-ab8981515fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.227454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580a61-7932-4e45-8b2e-ab8981515fa0 admin admin] PATH_INFO: `/v3/projects/bf95995343d547f78ae88a425f584ac7/users/e29a5217495c41dda9564db96f6e36d1/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.242764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a580a61-7932-4e45-8b2e-ab8981515fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf95995343d547f78ae88a425f584ac7, user_id=e29a5217495c41dda9564db96f6e36d1, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.245490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a580a61-7932-4e45-8b2e-ab8981515fa0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.259719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 798/1604] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:38 2022] PUT /identity/v3/projects/bf95995343d547f78ae88a425f584ac7/users/e29a5217495c41dda9564db96f6e36d1/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:38.261001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20099-bd53-4dd3-b7cb-56a200bfe6bd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.261299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20099-bd53-4dd3-b7cb-56a200bfe6bd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.261585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20099-bd53-4dd3-b7cb-56a200bfe6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.287185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 807/1605] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:38.289191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9c20099-bd53-4dd3-b7cb-56a200bfe6bd None None] MFA Rules not processed for user `7889e26696384400b300f4b8572ef515`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:38.290611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9c20099-bd53-4dd3-b7cb-56a200bfe6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:38.292132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.325739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:38.349584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5fd9d-d352-4e93-862b-e383258af1b6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.362039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 799/1606] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:38.363286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a794-6440-42d9-b29d-25d87286a0f0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.363646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a794-6440-42d9-b29d-25d87286a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.364089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a794-6440-42d9-b29d-25d87286a0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.382063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cb73a794-6440-42d9-b29d-25d87286a0f0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:38.383304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cb73a794-6440-42d9-b29d-25d87286a0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:38.402959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.403618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.403911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.404196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.445584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 800/1607] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:38.447141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.447545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.447937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.467992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.469457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.472066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:38.473265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:38.479775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 808/1608] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:38.480552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.484773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 801/1609] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:38.484773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.490828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f7c5b-33cc-4016-8250-b0ed7d5beab5 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.493785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911adc8-e4db-4f18-b652-ef948c7a7c00 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.496035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.496945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.497372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.497667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] PATH_INFO: `/v3/projects/196700c560cd4d6e9461ec9571facf39/users/1421fb674ae04d6ea9ae342b73ce8115/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.499640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b290e-f1d0-4949-a107-d758c937d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.500940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b290e-f1d0-4949-a107-d758c937d658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.501893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b290e-f1d0-4949-a107-d758c937d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.502335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b290e-f1d0-4949-a107-d758c937d658 admin admin] PATH_INFO: `/v3/projects/fbc2e2fc553742d89924ab47ce5aca4e/users/d7b4926059224f6d88bf53add30aec84/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.507646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:38.521565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196700c560cd4d6e9461ec9571facf39, user_id=1421fb674ae04d6ea9ae342b73ce8115, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.521876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b290e-f1d0-4949-a107-d758c937d658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc2e2fc553742d89924ab47ce5aca4e, user_id=d7b4926059224f6d88bf53add30aec84, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.524390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.524985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b290e-f1d0-4949-a107-d758c937d658 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.541881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 802/1610] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:38 2022] PUT /identity/v3/projects/fbc2e2fc553742d89924ab47ce5aca4e/users/d7b4926059224f6d88bf53add30aec84/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:38.543305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.543662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.544011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.552374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 809/1611] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:38 2022] PUT /identity/v3/projects/196700c560cd4d6e9461ec9571facf39/users/1421fb674ae04d6ea9ae342b73ce8115/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:38.553473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.562645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:38.564037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:38.646262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 803/1612] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:38.650794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.652590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9317b5-020b-4ebd-b3ce-7417ac07d390 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.723014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:38.730176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea74aea-cc2f-439a-9834-2182fc7f66ac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.735454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.737102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.737562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.737844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.756026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.756816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.757384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.757636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.814180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.816375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.827449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 804/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:38.831340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.849593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.851802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.867228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 810/1614] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:38.868632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:38.870509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:38.910366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360483f-cb61-48b3-ad68-5e54bd9d28ba service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.912262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:38.918285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6fa5-5cfb-4066-9bde-b0b3361e3e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.919022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6fa5-5cfb-4066-9bde-b0b3361e3e4f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.919414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6fa5-5cfb-4066-9bde-b0b3361e3e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.919700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6fa5-5cfb-4066-9bde-b0b3361e3e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.936151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6fa5-5cfb-4066-9bde-b0b3361e3e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.938376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6fa5-5cfb-4066-9bde-b0b3361e3e4f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.953991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 805/1615] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:38.956265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.956940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.957539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.961833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965ba15-2f4f-4ca4-bdb1-5752c97dcfff service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:38.966389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932f77c-1b64-499a-9bcb-b23bfd07b573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:38.967346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f77c-1b64-499a-9bcb-b23bfd07b573 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:38.967551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f77c-1b64-499a-9bcb-b23bfd07b573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:38.968097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f77c-1b64-499a-9bcb-b23bfd07b573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:38.996031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:38.996353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932f77c-1b64-499a-9bcb-b23bfd07b573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:38.997987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932f77c-1b64-499a-9bcb-b23bfd07b573 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:38.999015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:39.012886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 811/1616] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:39.015290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.015736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.019792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.024000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 806/1617] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:39.025138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:39.060230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db31c4-de5b-4c98-940a-ca8fb8a931b7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:39.065763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:39.070708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:39.071022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b219c-83a8-4dfb-9a66-09bb59e216cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:39.071891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b219c-83a8-4dfb-9a66-09bb59e216cd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.074015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b219c-83a8-4dfb-9a66-09bb59e216cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.074484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b219c-83a8-4dfb-9a66-09bb59e216cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.093889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 812/1618] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:39.096239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:39.100318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b219c-83a8-4dfb-9a66-09bb59e216cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:39.105050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b219c-83a8-4dfb-9a66-09bb59e216cd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:39.117848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2eb82-187e-4188-a33e-3fd8f1a1e345 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:39.122928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 807/1619] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:39.123591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:39.124379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.124501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c836d-3c12-4413-92d2-92030825ddba None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.124665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c836d-3c12-4413-92d2-92030825ddba None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.124936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.125044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c836d-3c12-4413-92d2-92030825ddba None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.125588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.131232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 808/1620] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 15:08:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:08:39.132980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.133276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.133626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.140888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:39.144230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:39.156172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:39.156898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 813/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:39.157659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:39.169397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 809/1622] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:08:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:39.185007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:39.196726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8cebd-128c-439e-bd8b-3054ed2faa26 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:39.202198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dd21b-6105-4418-ae06-d7808b17dffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:39.203002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd21b-6105-4418-ae06-d7808b17dffa service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.203562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd21b-6105-4418-ae06-d7808b17dffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.203932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd21b-6105-4418-ae06-d7808b17dffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.217957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dd21b-6105-4418-ae06-d7808b17dffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:39.219741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dd21b-6105-4418-ae06-d7808b17dffa service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:39.239676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 814/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:39.255709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:39.271525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b97c-d75f-4e00-8b7c-fcc44861501e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:39.284367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024a428-cf18-4660-a419-b8847e180d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:39.287861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024a428-cf18-4660-a419-b8847e180d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:39.288814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024a428-cf18-4660-a419-b8847e180d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:39.289209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024a428-cf18-4660-a419-b8847e180d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:39.315179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024a428-cf18-4660-a419-b8847e180d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:39.316641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024a428-cf18-4660-a419-b8847e180d65 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:39.331663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 810/1624] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:08:40.437561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a166-eef0-4e0b-a988-91f2d34e7875 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:40.438073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a166-eef0-4e0b-a988-91f2d34e7875 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:40.439350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a166-eef0-4e0b-a988-91f2d34e7875 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:40.441121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 815/1625] 10.222.0.45 () {54 vars in 961 bytes} [Thu May 26 15:08:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:08:40.461247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053740d6-939c-4e34-b669-8a58ecbf4b86 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:40.462755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053740d6-939c-4e34-b669-8a58ecbf4b86 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:40.464913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053740d6-939c-4e34-b669-8a58ecbf4b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:40.503674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-053740d6-939c-4e34-b669-8a58ecbf4b86 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:40.505072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-053740d6-939c-4e34-b669-8a58ecbf4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:40.519435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 811/1626] 10.222.0.45 () {58 vars in 1058 bytes} [Thu May 26 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:40.526478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e64b6-ee70-4e08-ac3e-0e41bdbb1949 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:40.526891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e64b6-ee70-4e08-ac3e-0e41bdbb1949 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:40.527353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e64b6-ee70-4e08-ac3e-0e41bdbb1949 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:40.529041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 816/1627] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 15:08:40.537718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa965-0179-426c-b817-7ffd585b77c1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:40.538186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa965-0179-426c-b817-7ffd585b77c1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:40.538571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa965-0179-426c-b817-7ffd585b77c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:40.570195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b27fa965-0179-426c-b817-7ffd585b77c1 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:40.571625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b27fa965-0179-426c-b817-7ffd585b77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:40.628449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e64b6-ee70-4e08-ac3e-0e41bdbb1949 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:40.643231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 812/1628] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:40.648631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e64b6-ee70-4e08-ac3e-0e41bdbb1949 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:40.653871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251031-d1fa-42ad-bfca-410924992373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:40.655846 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251031-d1fa-42ad-bfca-410924992373 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:40.656259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251031-d1fa-42ad-bfca-410924992373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:40.656652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251031-d1fa-42ad-bfca-410924992373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:40.677401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c251031-d1fa-42ad-bfca-410924992373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:40.679368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c251031-d1fa-42ad-bfca-410924992373 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:40.711924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 817/1629] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:41.479689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:41.480614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:41.481046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:41.512500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] MFA Rules not processed for user `3b7a1284bc044e51923c72a9f8f41d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:41.513473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:41.591420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:41.647172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 813/1630] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:41.658941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6ae5-6a3c-4def-a04d-ad1b6e099135 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:41.659563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6ae5-6a3c-4def-a04d-ad1b6e099135 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:41.659563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6ae5-6a3c-4def-a04d-ad1b6e099135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:41.741115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d12a6ae5-6a3c-4def-a04d-ad1b6e099135 None None] MFA Rules not processed for user `3b7a1284bc044e51923c72a9f8f41d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:41.747718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d12a6ae5-6a3c-4def-a04d-ad1b6e099135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:41.771925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 818/1631] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:41.784396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:41.816151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f609cb0-2e86-4247-9e58-8814802a6ab3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:41.822596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:41.823962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:41.824609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:41.825301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:41.843332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:41.848720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:41.870922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 814/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:08:42.443727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:42.444019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:42.444600 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:42.500080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] MFA Rules not processed for user `d7b4926059224f6d88bf53add30aec84`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:42.502838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:42.688004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 819/1633] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:42.693915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:42.719759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411ecd4-4cf2-4c7a-bfe1-32dabee575fd service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:42.744721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:42.745416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:42.745689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:42.747716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:42.747716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:42.752286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:42.856947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 815/1634] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:42 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:42.862466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:42.886464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90c37-1a1f-4c5d-bb95-3c31960a6cf9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:43.042572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:43.044784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.045822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.047317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.048605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:43.055023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:43.079683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:43.109912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 820/1635] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:42 2022] POST /identity/v3/users => generated 308 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:43.112027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:43.125321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33fdc8-42e1-4346-ae75-7bbc544b16a7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:43.142565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:43.147791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.148127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.148711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.150038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:43.151716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:43.171955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 816/1636] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:43.176680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:43.193250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df497-0b75-4d64-982b-1fa3c68ca64e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:43.201365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:43.203156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.203459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.203791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] PATH_INFO: `/v3/projects/7567823f569c44d0b42d42b952854f56/users/228de5e167474109b9aa039a8f2a2262/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.227257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7567823f569c44d0b42d42b952854f56, user_id=228de5e167474109b9aa039a8f2a2262, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:43.230926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:43.256455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:43.257528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 821/1637] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:43 2022] PUT /identity/v3/projects/7567823f569c44d0b42d42b952854f56/users/228de5e167474109b9aa039a8f2a2262/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:43.268046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129d78-1c6d-4da6-89ed-040ae5a6a3a8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:43.392662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfcaff-df91-4a3e-a9ff-dfc9820adeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:43.393469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfcaff-df91-4a3e-a9ff-dfc9820adeca admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.394482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfcaff-df91-4a3e-a9ff-dfc9820adeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.396188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfcaff-df91-4a3e-a9ff-dfc9820adeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.397767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfcaff-df91-4a3e-a9ff-dfc9820adeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:43.400620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfcaff-df91-4a3e-a9ff-dfc9820adeca admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:43.417962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:43.429405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 817/1638] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:08:43.435709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992f735-5885-455d-981b-a05525e6b9a1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:43.445219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934a992-f4e8-45a3-9ce0-85f4efe87c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:43.448190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a992-f4e8-45a3-9ce0-85f4efe87c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.448719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a992-f4e8-45a3-9ce0-85f4efe87c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.449454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a992-f4e8-45a3-9ce0-85f4efe87c20 admin admin] PATH_INFO: `/v3/projects/7567823f569c44d0b42d42b952854f56/users/228de5e167474109b9aa039a8f2a2262/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.455479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934a992-f4e8-45a3-9ce0-85f4efe87c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7567823f569c44d0b42d42b952854f56, user_id=228de5e167474109b9aa039a8f2a2262, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:43.459302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934a992-f4e8-45a3-9ce0-85f4efe87c20 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:43.497429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 822/1639] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:08:43 2022] PUT /identity/v3/projects/7567823f569c44d0b42d42b952854f56/users/228de5e167474109b9aa039a8f2a2262/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:43.652258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfc36a-06b6-4f7c-8285-4d10e6cc5d37 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.652902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfc36a-06b6-4f7c-8285-4d10e6cc5d37 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.653697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfc36a-06b6-4f7c-8285-4d10e6cc5d37 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.656498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 818/1640] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 15:08:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:08:43.664168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889788c1-8f5d-4eff-a6f3-c54306933828 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:43.664814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889788c1-8f5d-4eff-a6f3-c54306933828 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:43.665327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889788c1-8f5d-4eff-a6f3-c54306933828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:43.838676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-889788c1-8f5d-4eff-a6f3-c54306933828 None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:43.844438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-889788c1-8f5d-4eff-a6f3-c54306933828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:43.950114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 823/1641] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:44.004070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfc36a-06b6-4f7c-8285-4d10e6cc5d37 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:44.023994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfc36a-06b6-4f7c-8285-4d10e6cc5d37 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:44.067170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540b8b6-435b-4528-ae03-be19ae59c2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:44.067170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540b8b6-435b-4528-ae03-be19ae59c2bf service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:44.067170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540b8b6-435b-4528-ae03-be19ae59c2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:44.067170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540b8b6-435b-4528-ae03-be19ae59c2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:44.098944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540b8b6-435b-4528-ae03-be19ae59c2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:44.098944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540b8b6-435b-4528-ae03-be19ae59c2bf service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:44.115295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 819/1642] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:08:45.958486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eeccf-2075-45a4-9f0d-fefb21b63827 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:45.958920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eeccf-2075-45a4-9f0d-fefb21b63827 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:45.958984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eeccf-2075-45a4-9f0d-fefb21b63827 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:45.960396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 824/1643] 10.222.0.45 () {54 vars in 960 bytes} [Thu May 26 15:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:08:45.966443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbff49-77e3-4c02-9d70-f50bd0d469a4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:45.966972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbff49-77e3-4c02-9d70-f50bd0d469a4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:45.970274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbff49-77e3-4c02-9d70-f50bd0d469a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:46.019145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e4cbff49-77e3-4c02-9d70-f50bd0d469a4 None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:46.020469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4cbff49-77e3-4c02-9d70-f50bd0d469a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:46.146310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 820/1644] 10.222.0.45 () {58 vars in 1057 bytes} [Thu May 26 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:08:46.154694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eeccf-2075-45a4-9f0d-fefb21b63827 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:46.179849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eeccf-2075-45a4-9f0d-fefb21b63827 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:46.203873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:46.204799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:46.205073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:46.205351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:46.208222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:46.252780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:46.262503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01a1f-125f-4f4c-a383-2a5ce39ef993 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:46.294552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 825/1645] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:47.020388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:47.021223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:47.021647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:47.075923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:47.086466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] MFA Rules not processed for user `228de5e167474109b9aa039a8f2a2262`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:47.100320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:47.332124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 821/1646] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:50.135167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32753-025c-4761-bf30-a0ecd37a4650 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:50.135697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32753-025c-4761-bf30-a0ecd37a4650 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:50.135697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32753-025c-4761-bf30-a0ecd37a4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:50.174770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-48e32753-025c-4761-bf30-a0ecd37a4650 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:50.176077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-48e32753-025c-4761-bf30-a0ecd37a4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:50.330923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 826/1647] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:50.619497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:50.621962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:50.780832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6ad0-5158-4377-8852-53c80df47314 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:50.796749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4be971-9a90-44be-afe2-484e36572bd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:50.798520 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be971-9a90-44be-afe2-484e36572bd9 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:50.799074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be971-9a90-44be-afe2-484e36572bd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:50.799471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be971-9a90-44be-afe2-484e36572bd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:50.818178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4be971-9a90-44be-afe2-484e36572bd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:50.820769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4be971-9a90-44be-afe2-484e36572bd9 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:50.845818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 822/1648] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:08:51.132169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842691a-283f-49b5-a644-3eb786c88b55 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:51.135714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842691a-283f-49b5-a644-3eb786c88b55 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:51.138062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842691a-283f-49b5-a644-3eb786c88b55 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:51.141599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 827/1649] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:08:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:08:51.302388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:51.303201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:51.303686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:51.365337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:51.366679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:51.397253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 823/1650] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:08:51.837431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842691a-283f-49b5-a644-3eb786c88b55 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:51.871339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842691a-283f-49b5-a644-3eb786c88b55 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:51.928440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7707d-8805-4fe8-a6fc-16a821f0d89d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:51.936025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7707d-8805-4fe8-a6fc-16a821f0d89d service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:51.937456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7707d-8805-4fe8-a6fc-16a821f0d89d service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:51.940722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7707d-8805-4fe8-a6fc-16a821f0d89d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:52.005408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7707d-8805-4fe8-a6fc-16a821f0d89d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:52.015574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7707d-8805-4fe8-a6fc-16a821f0d89d service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:52.089738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 828/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:52.138670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:52.338367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41925446-bb99-412c-8ef9-c05f2315f878 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:52.350015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:52.351036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:52.351526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:52.351939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] PATH_INFO: `/v3/users/fb6aefbbf3a143e394e3b568371c060f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:52.354885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6aefbbf3a143e394e3b568371c060f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:52.357185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:52.448303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:52.558972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6aefbbf3a143e394e3b568371c060f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:52.560464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6aefbbf3a143e394e3b568371c060f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:52.599801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6aefbbf3a143e394e3b568371c060f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:52.601013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6aefbbf3a143e394e3b568371c060f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:52.632042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6aefbbf3a143e394e3b568371c060f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:52.687184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 824/1652] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:08:52 2022] DELETE /identity/v3/users/fb6aefbbf3a143e394e3b568371c060f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:52.690131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e479e-87bb-4621-8f97-640a3ec64e7e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:52.690661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e479e-87bb-4621-8f97-640a3ec64e7e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:52.690872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e479e-87bb-4621-8f97-640a3ec64e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:52.732288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f90e479e-87bb-4621-8f97-640a3ec64e7e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:52.733942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f90e479e-87bb-4621-8f97-640a3ec64e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:52.821155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:52.893491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 829/1653] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:52.951485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:52.952944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:53.171261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2d9d-029c-4570-a81c-40e8fb32704f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:53.175951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a75e-d87c-4716-9f12-268044ff6629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:53.176827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a75e-d87c-4716-9f12-268044ff6629 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:53.177420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a75e-d87c-4716-9f12-268044ff6629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:53.177858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a75e-d87c-4716-9f12-268044ff6629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:53.189578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a75e-d87c-4716-9f12-268044ff6629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:53.191615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a75e-d87c-4716-9f12-268044ff6629 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:53.204038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 825/1654] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:56.318078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:56.327024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:56.331483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:56.359474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:56.368143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:56.380555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 830/1655] 10.222.0.71 () {58 vars in 1015 bytes} [Thu May 26 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:56.598563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:56.599268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:56.599268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:56.617468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:56.618998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:56.690352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee688ef3-b7cf-4047-bc43-3d40e372a242 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:56.713533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] MFA Rules not processed for user `9a671e0538ca45bbb44c298f1aa13a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:56.714815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:56.715518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:56.719786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:56.720280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:56.720794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:56.737619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:56.741188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:56.773021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 831/1656] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:08:56.975208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 826/1657] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:57.013630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:57.017280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:57.093611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:57.097505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:57.152913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d2c2-4155-4c49-9b83-621d453002be None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:57.176905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:57.183629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:57.184457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:57.185474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] PATH_INFO: `/v3/projects/c05d2d0c2652419a97189c0a5d55892c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:57.189522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05d2d0c2652419a97189c0a5d55892c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:57.209069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:57.209069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: warnings.warn(msg) May 26 15:08:57.209069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: May 26 15:08:57.215985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:57.379516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba952195-973f-4e39-864f-53c6761133c5 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:57.390967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:57.404796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be658-c0fd-46fd-a619-4ea89e97e418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:57.410193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be658-c0fd-46fd-a619-4ea89e97e418 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:57.410779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be658-c0fd-46fd-a619-4ea89e97e418 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:57.412222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be658-c0fd-46fd-a619-4ea89e97e418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:57.434567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be658-c0fd-46fd-a619-4ea89e97e418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:57.437254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be658-c0fd-46fd-a619-4ea89e97e418 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:57.452664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05d2d0c2652419a97189c0a5d55892c', 'request_id': 'req-e6d083fa-c502-4e36-a57d-5092a34c087f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:57.479313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 832/1658] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:57.491888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05d2d0c2652419a97189c0a5d55892c', 'request_id': 'req-e6d083fa-c502-4e36-a57d-5092a34c087f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:57.524579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05d2d0c2652419a97189c0a5d55892c', 'request_id': 'req-e6d083fa-c502-4e36-a57d-5092a34c087f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:57.571300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] The token cache is being invalidate because project c05d2d0c2652419a97189c0a5d55892c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:08:57.572217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:57.573313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6d083fa-c502-4e36-a57d-5092a34c087f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:57.576318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 827/1659] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:08:57 2022] DELETE /identity/v3/projects/c05d2d0c2652419a97189c0a5d55892c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:57.582594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:57.582904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:57.583236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:57.645950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:57.654986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:57.938266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 833/1660] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:57.951652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:57.953000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:57.955144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:57.961030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:57.962682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:57.996816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac41e3-6b10-4209-ac73-788e78b439ac None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:58.002221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:58.004291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:58.020808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:58.021731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:58.022020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:58.022299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] PATH_INFO: `/v3/users/7889e26696384400b300f4b8572ef515` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:58.028174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7889e26696384400b300f4b8572ef515)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:58.029268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:58.029268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: warnings.warn(msg) May 26 15:08:58.029268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: May 26 15:08:58.039631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 828/1661] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:58.041179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:58.068541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:58.105739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a197f8-4c31-4efe-9c59-876ea0e2fad5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:58.146894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:58.149729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:58.150309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:58.150805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:58.152212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:08:58.152754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:58.156305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df5745-be24-4fac-912a-aec566246164 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:58.191447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:58.218051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 829/1662] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:08:58.221511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9484-1d2a-4120-8802-f06e624d940b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:58.222426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9484-1d2a-4120-8802-f06e624d940b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:58.223330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9484-1d2a-4120-8802-f06e624d940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:58.252515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7889e26696384400b300f4b8572ef515'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:58.270628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-314d9484-1d2a-4120-8802-f06e624d940b None None] MFA Rules not processed for user `1421fb674ae04d6ea9ae342b73ce8115`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:58.272779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7889e26696384400b300f4b8572ef515'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:58.273570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7889e26696384400b300f4b8572ef515'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:58.276063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-314d9484-1d2a-4120-8802-f06e624d940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:58.316031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7889e26696384400b300f4b8572ef515'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:58.317945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7889e26696384400b300f4b8572ef515'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:08:58.378982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 834/1663] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:08:57 2022] DELETE /identity/v3/users/7889e26696384400b300f4b8572ef515 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:08:58.388828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:58.394176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:58.434778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 830/1664] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:58.436218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:58.436519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:58.436811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:58.479848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:08:58.484674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:58.759042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 831/1665] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:08:58.764330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:58.776677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:58.779551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c1dd-8e7d-485d-89b5-ee40c9ca7984 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:58.790062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:58.801670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:58.802273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:58.816513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:58.818084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:58.831811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:58.886449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:58.939847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 835/1666] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:08:58 2022] POST /identity/v3/projects => generated 375 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:08:58.941024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:58.963964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:59.019460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66d4f5-b86b-4f49-b15d-44050146c05e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:59.294279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:59.295448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:59.296002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:59.298160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:59.496179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:59.498067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:59.522283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 832/1667] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:59.523336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:59.525329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:08:59.790994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269438b-3ed5-44cb-b59e-ebb880f2bc3f service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:59.806967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:59.810019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:59.810019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:59.810019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:59.831019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df246c86-66b6-4316-8e13-6a9df4c275e9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:59.843635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:59.856305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:59.856476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:59.856476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:59.856476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] PATH_INFO: `/v3/users/d7b4926059224f6d88bf53add30aec84` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:59.856969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:59.857051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b4926059224f6d88bf53add30aec84)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:59.857051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:08:59.887584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 833/1668] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:08:59.889167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:08:59.901747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:59.913669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db80f3f-f0f7-4be0-9528-673b953f176f service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:08:59.949229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179c437-2a6f-418e-9ff4-d9f6e09a63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:08:59.950974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c437-2a6f-418e-9ff4-d9f6e09a63ab admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:08:59.951369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c437-2a6f-418e-9ff4-d9f6e09a63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:08:59.953070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c437-2a6f-418e-9ff4-d9f6e09a63ab admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:08:59.955207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179c437-2a6f-418e-9ff4-d9f6e09a63ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:08:59.971831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:59.974878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179c437-2a6f-418e-9ff4-d9f6e09a63ab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:00.002849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b4926059224f6d88bf53add30aec84'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:00.029122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b4926059224f6d88bf53add30aec84'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:00.030031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b4926059224f6d88bf53add30aec84'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:00.057579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 834/1669] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:08:59 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:00.059189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a8c0-a710-4ad1-aa42-540c6708b642 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:00.059983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a8c0-a710-4ad1-aa42-540c6708b642 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:00.060287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a8c0-a710-4ad1-aa42-540c6708b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:00.092092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b4926059224f6d88bf53add30aec84'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:00.095271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b4926059224f6d88bf53add30aec84'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:00.099319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0a06a8c0-a710-4ad1-aa42-540c6708b642 None None] MFA Rules not processed for user `e29a5217495c41dda9564db96f6e36d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:00.100555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0a06a8c0-a710-4ad1-aa42-540c6708b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:00.158963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 836/1670] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:08:58 2022] DELETE /identity/v3/users/d7b4926059224f6d88bf53add30aec84 => generated 0 bytes in 1218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:00.159642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:00.161723 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:00.264827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 835/1671] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:00.269112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:00.269410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:00.270352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:00.372051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] MFA Rules not processed for user `1748648695bb46a9b2c7912c48e95bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:00.378146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:00.433543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4ae-c697-4694-b28c-c1072f3c8be4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:00.470705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be60e3-837b-4ad6-b963-332660acb733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:00.475677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be60e3-837b-4ad6-b963-332660acb733 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:00.484240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be60e3-837b-4ad6-b963-332660acb733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:00.485574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be60e3-837b-4ad6-b963-332660acb733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:00.487729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be60e3-837b-4ad6-b963-332660acb733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:00.494455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be60e3-837b-4ad6-b963-332660acb733 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:00.568867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 837/1672] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:00.574230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:00.575907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:00.580039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:00.672571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] MFA Rules not processed for user `e29a5217495c41dda9564db96f6e36d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:00.682649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:00.853986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 836/1673] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:00.856113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:00.887346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5407581-26b8-4173-a28c-ab192a055830 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:00.907126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 838/1674] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:00.911958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:00.916516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:00.917304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:00.917982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:00.918091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:00.918685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:00.919684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:00.922919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:00.969081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 837/1675] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:00.974357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:01.013449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4071f-8359-47e2-81c0-cab8ee62022a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:01.037608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035174b9-4cb3-487f-badd-aaf7910ece92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:01.038813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035174b9-4cb3-487f-badd-aaf7910ece92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:01.041351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035174b9-4cb3-487f-badd-aaf7910ece92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:01.041716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035174b9-4cb3-487f-badd-aaf7910ece92 admin admin] PATH_INFO: `/v3/projects/f7650ecca019422fa96d994597396dc2/users/33b4b7c429734c0ba77551961ac2d472/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:01.086789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035174b9-4cb3-487f-badd-aaf7910ece92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7650ecca019422fa96d994597396dc2, user_id=33b4b7c429734c0ba77551961ac2d472, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:01.096767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035174b9-4cb3-487f-badd-aaf7910ece92 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:01.144840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:01.165039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 838/1676] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:00 2022] PUT /identity/v3/projects/f7650ecca019422fa96d994597396dc2/users/33b4b7c429734c0ba77551961ac2d472/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:01.170864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e75d8-a532-40f6-966d-9a73b44ddfb7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:01.171348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e75d8-a532-40f6-966d-9a73b44ddfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:01.171615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e75d8-a532-40f6-966d-9a73b44ddfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:01.208348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0ee61-b0c5-4fca-b26a-1343a6057196 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:01.261805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a76e75d8-a532-40f6-966d-9a73b44ddfb7 None None] MFA Rules not processed for user `33b4b7c429734c0ba77551961ac2d472`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:01.263110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a76e75d8-a532-40f6-966d-9a73b44ddfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:01.328281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:01.496267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 839/1677] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:01.497903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cccfe-0a30-4ea0-b50c-feee661fd6c5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:01.498194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cccfe-0a30-4ea0-b50c-feee661fd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:01.498484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cccfe-0a30-4ea0-b50c-feee661fd6c5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:01.500851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:01.504762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:01.506409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 840/1678] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:09:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:09:01.507920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:01.511407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:01.680315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:01.680669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:01.680889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:01.689528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:01.692554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:01.718497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:01.721162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:01.726477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 839/1679] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:01.747525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 841/1680] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:09:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:01.887830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:01.889358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:01.924679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:01.926109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:01.961476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0fe95-d954-469c-9241-faae9c681f38 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:01.987880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:01.988583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:01.988902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:01.989183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:02.128191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627270-0453-4f43-9fbf-d02fd90f50d4 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:02.144409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:02.147947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:02.149054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:02.150263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] PATH_INFO: `/v3/projects/fbc2e2fc553742d89924ab47ce5aca4e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:02.153238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc2e2fc553742d89924ab47ce5aca4e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:02.162091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:02.225574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:02.234011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:02.263220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:02.278709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 842/1681] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:09:02.282523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:02.307934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36470ae-5aeb-4bb3-9787-b1134fbeb599 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:02.317774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc2e2fc553742d89924ab47ce5aca4e', 'request_id': 'req-8ba0d475-cce6-45af-a093-0806c431760d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.350157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc2e2fc553742d89924ab47ce5aca4e', 'request_id': 'req-8ba0d475-cce6-45af-a093-0806c431760d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.377981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc2e2fc553742d89924ab47ce5aca4e', 'request_id': 'req-8ba0d475-cce6-45af-a093-0806c431760d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.414489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] The token cache is being invalidate because project fbc2e2fc553742d89924ab47ce5aca4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:02.414871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.417058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.422680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 840/1682] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:01 2022] DELETE /identity/v3/projects/fbc2e2fc553742d89924ab47ce5aca4e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:02.423902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:02.434023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:02.523496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:02.526777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:02.527282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:02.529360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:02.536475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:02.628332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d475-cce6-45af-a093-0806c431760d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:02.649750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:02.650641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:02.650935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:02.651261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] PATH_INFO: `/v3/users/228de5e167474109b9aa039a8f2a2262` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:02.652771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=228de5e167474109b9aa039a8f2a2262)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:02.655299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:02.683949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:02.710277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:02.725675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:02.741982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 843/1683] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:02.791925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:02.794085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:02.800690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228de5e167474109b9aa039a8f2a2262'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.823183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228de5e167474109b9aa039a8f2a2262'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.824315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228de5e167474109b9aa039a8f2a2262'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.830711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cae7c-2402-4830-985d-e14c0f6ec4ed service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:02.850525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:02.858274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:02.858481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:02.859186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:02.866440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228de5e167474109b9aa039a8f2a2262'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.867120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:02.868519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228de5e167474109b9aa039a8f2a2262'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:02.917456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 841/1684] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:02 2022] DELETE /identity/v3/users/228de5e167474109b9aa039a8f2a2262 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:02.920233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:02.928251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3525bc-d931-4a14-8f95-03dc875ddcac service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:02.975560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 844/1685] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:09:03.588115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:03.590509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:03.722289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:03.784622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f929d4-7221-46ff-b95f-29e12f3db8dc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:03.799763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:03.800855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:03.801258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:03.803466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] PATH_INFO: `/v3/projects/4f0c728c3f0f4831ac6839d00bf0d7fc` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:03.805172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0c728c3f0f4831ac6839d00bf0d7fc)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:03.807590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:03.954177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0c728c3f0f4831ac6839d00bf0d7fc', 'request_id': 'req-cb7485fe-9147-457c-8fbd-32cf654ae0af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:03.969722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0c728c3f0f4831ac6839d00bf0d7fc', 'request_id': 'req-cb7485fe-9147-457c-8fbd-32cf654ae0af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:03.985782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0c728c3f0f4831ac6839d00bf0d7fc', 'request_id': 'req-cb7485fe-9147-457c-8fbd-32cf654ae0af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:04.056378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] The token cache is being invalidate because project 4f0c728c3f0f4831ac6839d00bf0d7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:04.056777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:04.059988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb7485fe-9147-457c-8fbd-32cf654ae0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:04.062169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 842/1686] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:03 2022] DELETE /identity/v3/projects/4f0c728c3f0f4831ac6839d00bf0d7fc => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:04.067235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:04.067762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:04.067859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:04.107618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:04.108861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:04.306506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 845/1687] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:04.308335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:04.308636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:04.308981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:04.353805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:04.354990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:04.397604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 843/1688] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:04.402094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:04.418720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a26cf7-5915-4493-af47-e1939e066557 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:04.439284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:04.439980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:04.440263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:04.440541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:04.441294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:04.441600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:04.443492 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:04.474920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 846/1689] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:04.478320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:04.488837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ae8c1-e6ff-44a0-876e-ccb8d031e40b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:04.519822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:04.520585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:04.520880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:04.521162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:04.521870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:04.538544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:04.605182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 844/1690] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:04 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:04.609470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:04.625424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51acd64-6306-4e01-86fe-e4e5ea1a1e7d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:04.777572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:04.778275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:04.778567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:04.778839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:04.779623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:04.781578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:04.835509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 847/1691] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:04 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:04.840169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:04.884544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b169e-d539-4583-a9be-d0ac9665f5a7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:04.905602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:04.906435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:04.907297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:04.907610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:04.908393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:04.910037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:04.976173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:04.978376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 845/1692] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:04.995927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fce85-a436-4036-9308-86671255f9e7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:05.009365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b2bc7-85d8-4ef3-b306-bbd552dfba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:05.010073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2bc7-85d8-4ef3-b306-bbd552dfba33 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:05.010414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2bc7-85d8-4ef3-b306-bbd552dfba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:05.010642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2bc7-85d8-4ef3-b306-bbd552dfba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:05.011603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b2bc7-85d8-4ef3-b306-bbd552dfba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:05.013635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b2bc7-85d8-4ef3-b306-bbd552dfba33 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:05.052064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 848/1693] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:05.055463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:05.096214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a667-66ae-47b6-9731-1984af5df501 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:05.111690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:05.113166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:05.113730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:05.114225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] PATH_INFO: `/v3/projects/68385c04fe4c4264bdf1aac7a2c7efd0/users/87ca47e7461f485f87537b2a7db0deda/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:05.165129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68385c04fe4c4264bdf1aac7a2c7efd0, user_id=87ca47e7461f485f87537b2a7db0deda, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:05.168385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:05.214478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 846/1694] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:05 2022] PUT /identity/v3/projects/68385c04fe4c4264bdf1aac7a2c7efd0/users/87ca47e7461f485f87537b2a7db0deda/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:05.221607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:05.222158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:05.222158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:05.310723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] MFA Rules not processed for user `87ca47e7461f485f87537b2a7db0deda`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:05.354964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:05.556912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:05.670465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:05.673949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:05.762665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 849/1695] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:05.769905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:05.946787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d86e3d-3780-4774-a20a-94fee7aedb1f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:05.972683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:05.975834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:05.977721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:05.979031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] PATH_INFO: `/v3/users/33b4b7c429734c0ba77551961ac2d472` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:05.982268 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b4b7c429734c0ba77551961ac2d472)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:05.989605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:06.008015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:06.108050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0216e-acfa-4c29-94d3-6abc8ea31a18 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:06.126428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:06.127230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:06.127643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:06.131900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:06.136200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:06.148986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:06.151200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b4b7c429734c0ba77551961ac2d472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.171035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b4b7c429734c0ba77551961ac2d472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.171704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b4b7c429734c0ba77551961ac2d472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.235491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 850/1696] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:05 2022] POST /identity/v3/projects => generated 373 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:06.241979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:06.246767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:06.272297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b4b7c429734c0ba77551961ac2d472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.279253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b4b7c429734c0ba77551961ac2d472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.385769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 847/1697] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:05 2022] DELETE /identity/v3/users/33b4b7c429734c0ba77551961ac2d472 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:06.385769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:06.390028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:06.479512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed36f-3a91-4d87-9899-f4c05945ebac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:06.579599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:06.580599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:06.581368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:06.581676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] PATH_INFO: `/v3/projects/7567823f569c44d0b42d42b952854f56` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:06.585108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7567823f569c44d0b42d42b952854f56)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:06.590146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:06.609066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:06.704269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011d25-6aea-4587-a943-62bd9ea393b9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:06.743407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7567823f569c44d0b42d42b952854f56', 'request_id': 'req-6d556b32-633e-4bc3-bd02-df5c497e9348'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.776792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7567823f569c44d0b42d42b952854f56', 'request_id': 'req-6d556b32-633e-4bc3-bd02-df5c497e9348'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.795882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7567823f569c44d0b42d42b952854f56', 'request_id': 'req-6d556b32-633e-4bc3-bd02-df5c497e9348'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.836689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] The token cache is being invalidate because project 7567823f569c44d0b42d42b952854f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:06.836896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.839914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d556b32-633e-4bc3-bd02-df5c497e9348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:06.856504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 851/1698] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:06 2022] DELETE /identity/v3/projects/7567823f569c44d0b42d42b952854f56 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:06.856504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073650-9a3e-47e0-b1b4-cd9eb25a755b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:06.861810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073650-9a3e-47e0-b1b4-cd9eb25a755b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:06.862536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073650-9a3e-47e0-b1b4-cd9eb25a755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:06.906028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd64bb-0531-453e-81f0-86bedc10624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:06.907507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd64bb-0531-453e-81f0-86bedc10624d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:06.907507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd64bb-0531-453e-81f0-86bedc10624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:06.907507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd64bb-0531-453e-81f0-86bedc10624d admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:06.909292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd64bb-0531-453e-81f0-86bedc10624d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:06.917018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd64bb-0531-453e-81f0-86bedc10624d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:06.943563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-66073650-9a3e-47e0-b1b4-cd9eb25a755b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:06.951060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66073650-9a3e-47e0-b1b4-cd9eb25a755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:06.967688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 848/1699] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:06 2022] POST /identity/v3/users => generated 293 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:06.970929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1ab6-8077-4f59-b3f7-fbe5910ba0d5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:06.970929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1ab6-8077-4f59-b3f7-fbe5910ba0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:06.971205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1ab6-8077-4f59-b3f7-fbe5910ba0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:06.987366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 852/1700] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:06.990129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:06.990431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:06.990719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.017082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3cde1ab6-8077-4f59-b3f7-fbe5910ba0d5 None None] MFA Rules not processed for user `e29a5217495c41dda9564db96f6e36d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:07.019121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3cde1ab6-8077-4f59-b3f7-fbe5910ba0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:07.053195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:07.054991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:07.059649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:07.072738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 853/1701] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:07.076690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.079668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:07.138602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b775de2-096f-4ad1-a021-a7fa6fabef2b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.162638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.163385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.163646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.163926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.164681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.166280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.202699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 854/1702] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:07.205003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.207553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 849/1703] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:07.209091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.209798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.209798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.217824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:07.277753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:07.278802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:07.311361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 850/1704] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:07.313089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.329131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307113-bc48-4f20-8a91-97c68c72f8da None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.344327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.347447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.348709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.348982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] PATH_INFO: `/v3/projects/0ae409e148254d12bc05b8fe37ed84c9/users/e7ac4244c98149729ddc85fce025ef49/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.374210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae409e148254d12bc05b8fe37ed84c9, user_id=e7ac4244c98149729ddc85fce025ef49, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.379060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.405391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 851/1705] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:07 2022] PUT /identity/v3/projects/0ae409e148254d12bc05b8fe37ed84c9/users/e7ac4244c98149729ddc85fce025ef49/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:07.408289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.419581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c823956-f938-4bc7-ac38-aca38a1e33d3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.534590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a3fa2-00b0-44aa-9899-b87765b5c5d0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.537148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.537838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.538129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.538469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.541729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.544023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.544575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.545131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.546170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:07.546585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.550460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.559324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.561739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.571919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 852/1706] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:07.573760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.592253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 855/1707] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:07.593124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.608071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee3d25-7e61-4516-b07b-750026aedbad admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.616489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.617715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288ca8-04e6-4565-bf6b-84d7231c2e38 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.618045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.618420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.618802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.619924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.622797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.629634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.630318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.630609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.630927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.631705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.634144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.647513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 853/1708] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:07.652146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.677836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a379-7b5e-4fff-83fd-40df38e8ee91 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.694641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494116-57b1-4b05-96f5-6cb9e7716fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.697311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494116-57b1-4b05-96f5-6cb9e7716fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.697931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494116-57b1-4b05-96f5-6cb9e7716fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.698493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494116-57b1-4b05-96f5-6cb9e7716fcc admin admin] PATH_INFO: `/v3/projects/0ae409e148254d12bc05b8fe37ed84c9/users/e7ac4244c98149729ddc85fce025ef49/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.702522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494116-57b1-4b05-96f5-6cb9e7716fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae409e148254d12bc05b8fe37ed84c9, user_id=e7ac4244c98149729ddc85fce025ef49, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.709803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494116-57b1-4b05-96f5-6cb9e7716fcc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:07.738484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 856/1709] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:07 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:07.739491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:07.740121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 854/1710] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:07 2022] PUT /identity/v3/projects/0ae409e148254d12bc05b8fe37ed84c9/users/e7ac4244c98149729ddc85fce025ef49/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:07.765835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.766152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.766482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.788606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:07.870976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] MFA Rules not processed for user `e7ac4244c98149729ddc85fce025ef49`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:07.872339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:07.945379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937eb5d-0143-444a-a943-6273da771935 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:07.960353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:07.961409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:07.961895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:07.962349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:07.963291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:07.965626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:08.017787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 857/1711] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:07 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:08.019162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:08.046290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:08.046581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e65cd-16ce-4dd5-ac1a-ec60ee9f7271 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:08.059888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:08.060659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.061259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.061568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.062321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:08.064878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:08.095734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 855/1712] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:08.108451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:08.110410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:08.111142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 858/1713] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:08.115661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:08.137697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb47001-2008-436b-bbbb-3576dca60e8f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:08.166253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb198-7118-4787-9a03-d4ac78e4b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:08.167332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb198-7118-4787-9a03-d4ac78e4b009 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.167752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb198-7118-4787-9a03-d4ac78e4b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.168170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb198-7118-4787-9a03-d4ac78e4b009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.170477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb198-7118-4787-9a03-d4ac78e4b009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:08.172517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb198-7118-4787-9a03-d4ac78e4b009 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:08.216164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 859/1714] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:08.222706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.223034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.223370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.269392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] MFA Rules not processed for user `9a671e0538ca45bbb44c298f1aa13a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:08.270989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:08.298120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505df3bb-acee-4664-a4b5-f004b2705305 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:08.310618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:08.311363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.311657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.311940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.338461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:08.340260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:08.366605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 856/1715] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:08.371475 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:08.406682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075900-1f24-4b72-bf48-be153999cb78 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:08.424565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10fe0-1e2c-4068-8edd-2005e50ad94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:08.425922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10fe0-1e2c-4068-8edd-2005e50ad94f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.426444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10fe0-1e2c-4068-8edd-2005e50ad94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.426890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10fe0-1e2c-4068-8edd-2005e50ad94f admin admin] PATH_INFO: `/v3/projects/26de4fefb855432d9b6aac2eccb8b9a0/users/ed3b91f4a26f410ba57d096abaa903ad/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.498900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10fe0-1e2c-4068-8edd-2005e50ad94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26de4fefb855432d9b6aac2eccb8b9a0, user_id=ed3b91f4a26f410ba57d096abaa903ad, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:08.507932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10fe0-1e2c-4068-8edd-2005e50ad94f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:08.587874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 857/1716] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:08 2022] PUT /identity/v3/projects/26de4fefb855432d9b6aac2eccb8b9a0/users/ed3b91f4a26f410ba57d096abaa903ad/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:08.593317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.594005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.594607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.599378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 860/1717] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:08.621168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:08.623693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:08.655067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d387c-0988-4a69-96a2-32000ac0772f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:08.707917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] MFA Rules not processed for user `ed3b91f4a26f410ba57d096abaa903ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:08.725247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:08.874440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:08.876121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:08.876568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:08.877025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] PATH_INFO: `/v3/projects/f7650ecca019422fa96d994597396dc2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:08.880453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7650ecca019422fa96d994597396dc2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:08.888712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:08.912909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 858/1718] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:08.924353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:08.975578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:09.010380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778413-ec09-4c56-92ba-edfe93d22c05 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.022420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7650ecca019422fa96d994597396dc2', 'request_id': 'req-cdaebfe0-f244-4043-bbcc-18757de3ad51'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:09.024721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:09.036792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7650ecca019422fa96d994597396dc2', 'request_id': 'req-cdaebfe0-f244-4043-bbcc-18757de3ad51'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:09.061211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7650ecca019422fa96d994597396dc2', 'request_id': 'req-cdaebfe0-f244-4043-bbcc-18757de3ad51'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:09.089579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] The token cache is being invalidate because project f7650ecca019422fa96d994597396dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:09.089975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:09.090758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:09.092724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 861/1719] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:08 2022] DELETE /identity/v3/projects/f7650ecca019422fa96d994597396dc2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:09.093584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.095062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:09.096968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.097867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.098328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.098812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.101295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:09.202427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.205001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891839a3-8016-4023-934f-ecdabbdcec3f service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.221759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 859/1720] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:09.223276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e226eda-f8d9-4c99-b0f0-9325b55bd85a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.226370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e226eda-f8d9-4c99-b0f0-9325b55bd85a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.226370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e226eda-f8d9-4c99-b0f0-9325b55bd85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.273357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4e226eda-f8d9-4c99-b0f0-9325b55bd85a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:09.275473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4e226eda-f8d9-4c99-b0f0-9325b55bd85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:09.292345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaebfe0-f244-4043-bbcc-18757de3ad51 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.295423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 860/1721] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:09.300215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d298-4f8c-4b94-adc3-63b939582450 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.300549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d298-4f8c-4b94-adc3-63b939582450 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.300784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d298-4f8c-4b94-adc3-63b939582450 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.306568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 861/1722] 10.222.0.45 () {54 vars in 912 bytes} [Thu May 26 15:09:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:09:09.307384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804abaf-ff87-4915-810e-be498113fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.307973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86269e2-78c3-479b-a741-10be0932840a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.308275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86269e2-78c3-479b-a741-10be0932840a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.308558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86269e2-78c3-479b-a741-10be0932840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.309126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804abaf-ff87-4915-810e-be498113fe8d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.310133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804abaf-ff87-4915-810e-be498113fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.311053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804abaf-ff87-4915-810e-be498113fe8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.313753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804abaf-ff87-4915-810e-be498113fe8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.316998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804abaf-ff87-4915-810e-be498113fe8d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.350665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b86269e2-78c3-479b-a741-10be0932840a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:09.351902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b86269e2-78c3-479b-a741-10be0932840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:09.393943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 862/1723] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:09 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:09.398274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 862/1724] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:09.399551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.399757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86269e2-78c3-479b-a741-10be0932840a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.399891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.400175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.434171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86269e2-78c3-479b-a741-10be0932840a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.444877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:09.448776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:09.577096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 863/1725] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:09.580147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.708276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.709535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.710048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.710153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:09.711055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.712360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.714765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.760695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 863/1726] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:09 2022] POST /identity/v3/users => generated 296 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:09.765274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.774989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be6a01-08b9-411c-acd5-70d00984b889 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.799546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.800506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.800937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.801348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9e5dc-7c5f-4b15-acca-1c199832315e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.801739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.802647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:09.803308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.805197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.813736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.814501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.814793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.815073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.816000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.817821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.839565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 864/1727] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:09.839565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.839565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:09.852515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 864/1728] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:09.853497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.858491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c45806-431a-4485-bf2e-1d16f41b3773 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.863122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50691474-db19-4b57-93d1-447312682912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.863689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50691474-db19-4b57-93d1-447312682912 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.863976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50691474-db19-4b57-93d1-447312682912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.864252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50691474-db19-4b57-93d1-447312682912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.878140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75412800-edf9-4e28-80f6-f0635138a93b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.881415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50691474-db19-4b57-93d1-447312682912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.883166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50691474-db19-4b57-93d1-447312682912 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.894469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 865/1729] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:09.894601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.895508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50691474-db19-4b57-93d1-447312682912 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:09.895864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.896228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.896723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] PATH_INFO: `/v3/projects/7f98a5ef75ae47f1afba1b09962e97fa/users/cb9c5a57571944a985eda0eb2943dfeb/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.920219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f98a5ef75ae47f1afba1b09962e97fa, user_id=cb9c5a57571944a985eda0eb2943dfeb, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.923817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.939378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50691474-db19-4b57-93d1-447312682912 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:09.947192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:09.948070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:09.948363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:09.948955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:09.951737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:09.956421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 865/1730] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:09 2022] PUT /identity/v3/projects/7f98a5ef75ae47f1afba1b09962e97fa/users/cb9c5a57571944a985eda0eb2943dfeb/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:09.957729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:09.960728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.014783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:10.031937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 866/1731] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:09 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:10.039432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.128282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fd0f5-bf48-439b-ad8f-15f7bf724640 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:10.227009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6785-7e34-4832-8c69-0b8947d56d3c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:10.249343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe4d97-7b7c-4ffb-8efc-c85da3cf4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:10.250283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe4d97-7b7c-4ffb-8efc-c85da3cf4edb admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.251837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe4d97-7b7c-4ffb-8efc-c85da3cf4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.251837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe4d97-7b7c-4ffb-8efc-c85da3cf4edb admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.252032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe4d97-7b7c-4ffb-8efc-c85da3cf4edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:10.257131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe4d97-7b7c-4ffb-8efc-c85da3cf4edb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:10.299482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:10.300300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.300692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.301088 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.301827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 867/1732] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:10 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:10.302108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:10.303466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.303803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.304146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:10.304274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.326787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] MFA Rules not processed for user `1421fb674ae04d6ea9ae342b73ce8115`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:10.328289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:10.331338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 866/1733] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:10.332920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.370934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dbe02-c9fe-4e91-a932-d1e64443bf1d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:10.380121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:10.381777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.382247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.382792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.383863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:10.386736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:10.401937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 867/1734] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:10.403286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.430556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29933a-94f1-4e8d-ad00-b8f14ece4bc8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:10.439753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 868/1735] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:10.441122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.451743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:10.454794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.458216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.458782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] PATH_INFO: `/v3/projects/7f98a5ef75ae47f1afba1b09962e97fa/users/cb9c5a57571944a985eda0eb2943dfeb/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.465869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f98a5ef75ae47f1afba1b09962e97fa, user_id=cb9c5a57571944a985eda0eb2943dfeb, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:10.470872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:10.472570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d70bb-487f-4ee8-988a-b06a8edddeb9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:10.482784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434f6fb-9e17-4055-8970-5f72e4206484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:10.483962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434f6fb-9e17-4055-8970-5f72e4206484 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.483962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434f6fb-9e17-4055-8970-5f72e4206484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.484270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434f6fb-9e17-4055-8970-5f72e4206484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.485493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434f6fb-9e17-4055-8970-5f72e4206484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:10.488419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434f6fb-9e17-4055-8970-5f72e4206484 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:10.511002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 868/1736] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:10 2022] PUT /identity/v3/projects/7f98a5ef75ae47f1afba1b09962e97fa/users/cb9c5a57571944a985eda0eb2943dfeb/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:10.518817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 869/1737] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:10.520874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.522233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.522629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.523334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.592846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:10.621949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] MFA Rules not processed for user `cb9c5a57571944a985eda0eb2943dfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:10.621949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:10.665436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6461-f8ec-4a44-bb9f-3c5610e06f50 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:10.673726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa7c55-a5a3-493f-aee9-c3740b50d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:10.674547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa7c55-a5a3-493f-aee9-c3740b50d75d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.674876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa7c55-a5a3-493f-aee9-c3740b50d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.676023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa7c55-a5a3-493f-aee9-c3740b50d75d admin admin] PATH_INFO: `/v3/projects/ed2e717c6b5b49d2934a0ce2015d7f0f/users/83788e22855b4546b734552cedd4b0f6/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.696975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa7c55-a5a3-493f-aee9-c3740b50d75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2e717c6b5b49d2934a0ce2015d7f0f, user_id=83788e22855b4546b734552cedd4b0f6, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:10.701266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa7c55-a5a3-493f-aee9-c3740b50d75d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:10.738055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 869/1738] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:10 2022] PUT /identity/v3/projects/ed2e717c6b5b49d2934a0ce2015d7f0f/users/83788e22855b4546b734552cedd4b0f6/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:10.739720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:10.740060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:10.740415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:10.820107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] MFA Rules not processed for user `83788e22855b4546b734552cedd4b0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:10.821553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:10.891945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 870/1739] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:10.912664 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:10.917422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:10.954724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:10.986302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 870/1740] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:10.991311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:11.061393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9c02-b632-443b-ab96-ebc9b7318523 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:11.176824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:11.178639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:11.180362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:11.181885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:11.211618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf8da2-5456-4afc-921b-18b4d9aa7d60 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:11.237543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:11.238858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:11.240934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:11.241331 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:11.242171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:11.252265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:11.381770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 871/1741] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:10 2022] POST /identity/v3/projects => generated 363 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:11.382787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:11.469803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:11.476767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:11.514434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 871/1742] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:09:11.529909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:11.594909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ead06-bdbd-4ec1-b7fa-ce8151ec7811 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:11.599645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:11.600610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:11.600903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:11.601374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:11.602745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:11.611019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:11.667317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 872/1743] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:11 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:11.669679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:11.684879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c116a-ae5f-4fda-abb7-e2c2c3f67b3d service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:11.702036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:11.702951 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:11.704725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:11.705261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:11.706266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:11.710216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:11.745647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 872/1744] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:11.748683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:11.764784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643a9ae-2edd-4de3-9e6a-8ce436ed36b8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:11.792027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:11.805541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:11.807830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:11.808173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] PATH_INFO: `/v3/projects/fd35555bbe1e4d238e9e827fd7221546/users/7f3772da9fe046e1a7b7f804af0a6b7f/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:11.819981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:11.942630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd35555bbe1e4d238e9e827fd7221546, user_id=7f3772da9fe046e1a7b7f804af0a6b7f, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:11.964551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:12.027848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5287-22ff-482f-b76a-58b435ae95bc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:12.032472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 873/1745] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:11 2022] PUT /identity/v3/projects/fd35555bbe1e4d238e9e827fd7221546/users/7f3772da9fe046e1a7b7f804af0a6b7f/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:12.041940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:12.095670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:12.283928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:12.285382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:12.285832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:12.286257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:12.288823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:12.294167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf8e4-90f5-4bf8-9b23-b7cb60ffe8cc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:12.314438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:12.315195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:12.315486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:12.315810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:12.319444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:12.319444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:12.346975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 874/1746] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:12.348364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:12.372743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f29e-79e7-4617-bee7-c61a433fce6d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:12.385627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fbb8e-a5cd-4f74-a362-7b55bcbb0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:12.386721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fbb8e-a5cd-4f74-a362-7b55bcbb0907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:12.387921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fbb8e-a5cd-4f74-a362-7b55bcbb0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:12.388951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fbb8e-a5cd-4f74-a362-7b55bcbb0907 admin admin] PATH_INFO: `/v3/projects/fd35555bbe1e4d238e9e827fd7221546/users/7f3772da9fe046e1a7b7f804af0a6b7f/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:12.394333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fbb8e-a5cd-4f74-a362-7b55bcbb0907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd35555bbe1e4d238e9e827fd7221546, user_id=7f3772da9fe046e1a7b7f804af0a6b7f, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:12.398518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fbb8e-a5cd-4f74-a362-7b55bcbb0907 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:12.412072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 875/1747] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:12 2022] PUT /identity/v3/projects/fd35555bbe1e4d238e9e827fd7221546/users/7f3772da9fe046e1a7b7f804af0a6b7f/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:12.416843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:12.425006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05a98-5130-40c4-965f-8a4f6be2422a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:12.425929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:12.426326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:12.426608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:12.460117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 873/1748] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:12.513987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] MFA Rules not processed for user `7f3772da9fe046e1a7b7f804af0a6b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:12.516199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:12.715780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:12.716560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:12.716560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:12.749613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] MFA Rules not processed for user `1748648695bb46a9b2c7912c48e95bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:12.753800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:12.785240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 876/1749] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:12.813457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:12.832633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:12.968912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4847558-b0ab-44fb-a2ec-1b5c06135650 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:12.981980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7782fe-619c-47cb-a3e6-067d0a61fa9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:12.982836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7782fe-619c-47cb-a3e6-067d0a61fa9f service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:12.983162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7782fe-619c-47cb-a3e6-067d0a61fa9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:12.983533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7782fe-619c-47cb-a3e6-067d0a61fa9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:13.010298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 874/1750] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:13.010523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7782fe-619c-47cb-a3e6-067d0a61fa9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:13.010523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7782fe-619c-47cb-a3e6-067d0a61fa9f service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:13.023513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 877/1751] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:13.192431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:13.216101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7094-1408-48fe-9b6c-16c0f5382db2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:13.242673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263b981-e43b-442e-99a3-b652810d486a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:13.243408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263b981-e43b-442e-99a3-b652810d486a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:13.244291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263b981-e43b-442e-99a3-b652810d486a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:13.247605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263b981-e43b-442e-99a3-b652810d486a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:13.440430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263b981-e43b-442e-99a3-b652810d486a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:13.447699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263b981-e43b-442e-99a3-b652810d486a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:13.494226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 875/1752] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:19.962499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a7e7-fbaf-4ae0-bd0e-9013d6746bce None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:19.963019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a7e7-fbaf-4ae0-bd0e-9013d6746bce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:19.963274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a7e7-fbaf-4ae0-bd0e-9013d6746bce None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:19.964797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 878/1753] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:09:19.988345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d0fb-115c-4950-85ed-b816cb97c4b1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:19.988920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d0fb-115c-4950-85ed-b816cb97c4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:19.988920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d0fb-115c-4950-85ed-b816cb97c4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:20.021172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-48d4d0fb-115c-4950-85ed-b816cb97c4b1 None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:20.023194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-48d4d0fb-115c-4950-85ed-b816cb97c4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:20.040032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:20.224903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 876/1754] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:09:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:20.299567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a7e7-fbaf-4ae0-bd0e-9013d6746bce None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:20.301540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-afe7a7e7-fbaf-4ae0-bd0e-9013d6746bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:20.340000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a7e7-fbaf-4ae0-bd0e-9013d6746bce None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:20.349292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778eeb8d-8612-452f-bd64-d30e2162b4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:20.350065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eeb8d-8612-452f-bd64-d30e2162b4fc service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:20.350498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eeb8d-8612-452f-bd64-d30e2162b4fc service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:20.350868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eeb8d-8612-452f-bd64-d30e2162b4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:20.367283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778eeb8d-8612-452f-bd64-d30e2162b4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:20.369831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778eeb8d-8612-452f-bd64-d30e2162b4fc service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:20.418746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 879/1755] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:25.295203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1571d-5b4e-4b91-b469-23d7f06c481c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:25.296056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1571d-5b4e-4b91-b469-23d7f06c481c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:25.296504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1571d-5b4e-4b91-b469-23d7f06c481c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:25.298562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 877/1756] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:09:25.321274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:25.323329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:25.324016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:25.355824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:25.357060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:25.369947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 880/1757] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:09:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:25.386302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1571d-5b4e-4b91-b469-23d7f06c481c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:25.388800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-15d1571d-5b4e-4b91-b469-23d7f06c481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:25.425129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1571d-5b4e-4b91-b469-23d7f06c481c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:25.442244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf2ddf-99b5-427a-8354-df34ae577899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:25.443125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2ddf-99b5-427a-8354-df34ae577899 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:25.443242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2ddf-99b5-427a-8354-df34ae577899 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:25.443714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf2ddf-99b5-427a-8354-df34ae577899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:25.469447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf2ddf-99b5-427a-8354-df34ae577899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:25.471219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf2ddf-99b5-427a-8354-df34ae577899 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:25.496565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 878/1758] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:32.245568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:32.399969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf63e4-6213-4217-9ef1-47d516fb2dad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:32.406509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:32.407937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:32.408594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:32.409076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] PATH_INFO: `/v3/users/ed3b91f4a26f410ba57d096abaa903ad` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:32.410602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3b91f4a26f410ba57d096abaa903ad)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:32.413567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:32.506233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3b91f4a26f410ba57d096abaa903ad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:32.507406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3b91f4a26f410ba57d096abaa903ad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:32.519425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3b91f4a26f410ba57d096abaa903ad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:32.520269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3b91f4a26f410ba57d096abaa903ad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:32.540329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3b91f4a26f410ba57d096abaa903ad'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:32.580720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 881/1759] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:32 2022] DELETE /identity/v3/users/ed3b91f4a26f410ba57d096abaa903ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:32.588948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:32.589473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:32.589553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:32.624252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:32.625737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:32.724938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 879/1760] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:32.741862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:32.741862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:32.751850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:32.810587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314979-f398-498f-9977-317e127e2da1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:32.816118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:32.816916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:32.817285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:32.817640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:32.830807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:32.832424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:32.844558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 882/1761] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:34.163882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:34.166477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:34.191793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d8c18-12c0-40d7-a8f6-fb786c1d60fd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:34.219972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:34.221775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:34.222370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:34.223008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] PATH_INFO: `/v3/projects/26de4fefb855432d9b6aac2eccb8b9a0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:34.225029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26de4fefb855432d9b6aac2eccb8b9a0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:34.228676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:34.295851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26de4fefb855432d9b6aac2eccb8b9a0', 'request_id': 'req-844bf5c3-da85-493c-bf49-17481909b33b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.303283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26de4fefb855432d9b6aac2eccb8b9a0', 'request_id': 'req-844bf5c3-da85-493c-bf49-17481909b33b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.317944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26de4fefb855432d9b6aac2eccb8b9a0', 'request_id': 'req-844bf5c3-da85-493c-bf49-17481909b33b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.333027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] The token cache is being invalidate because project 26de4fefb855432d9b6aac2eccb8b9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:34.333327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.333997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.335744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 880/1762] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:34 2022] DELETE /identity/v3/projects/26de4fefb855432d9b6aac2eccb8b9a0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:34.340229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:34.351062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cde8c3-26bf-4725-87c1-4e80440c59c7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:34.417266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:34.418367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:34.418654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:34.418989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] PATH_INFO: `/v3/users/cb9c5a57571944a985eda0eb2943dfeb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:34.420326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9c5a57571944a985eda0eb2943dfeb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:34.422387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:34.472632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9c5a57571944a985eda0eb2943dfeb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.473359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9c5a57571944a985eda0eb2943dfeb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.481672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9c5a57571944a985eda0eb2943dfeb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.482428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9c5a57571944a985eda0eb2943dfeb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.492404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9c5a57571944a985eda0eb2943dfeb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.511981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 883/1763] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:34 2022] DELETE /identity/v3/users/cb9c5a57571944a985eda0eb2943dfeb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:34.776907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:34.778423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:34.794591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf5c3-da85-493c-bf49-17481909b33b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:34.810135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:34.812679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:34.826870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:34.886904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:34.902888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:34.904185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:34.904617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:34.905047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] PATH_INFO: `/v3/users/83788e22855b4546b734552cedd4b0f6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:34.906490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83788e22855b4546b734552cedd4b0f6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:34.908633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:34.930978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96088-928a-4e3a-a1ca-2582d1a58e2d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:34.936514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:34.938957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:34.938957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:34.938957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] PATH_INFO: `/v3/projects/7f98a5ef75ae47f1afba1b09962e97fa` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:34.940305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f98a5ef75ae47f1afba1b09962e97fa)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:34.942407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:34.979162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83788e22855b4546b734552cedd4b0f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.991873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83788e22855b4546b734552cedd4b0f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:34.993075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83788e22855b4546b734552cedd4b0f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.014687 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83788e22855b4546b734552cedd4b0f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.015750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5435e0ac-0deb-4fed-9219-dfb383c73f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83788e22855b4546b734552cedd4b0f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.055625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 881/1764] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:34 2022] DELETE /identity/v3/users/83788e22855b4546b734552cedd4b0f6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:35.056305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f98a5ef75ae47f1afba1b09962e97fa', 'request_id': 'req-d8bb8276-403b-44d5-8414-bbdd525b6d53'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.059723 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.060020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.060308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.070497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f98a5ef75ae47f1afba1b09962e97fa', 'request_id': 'req-d8bb8276-403b-44d5-8414-bbdd525b6d53'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.090152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f98a5ef75ae47f1afba1b09962e97fa', 'request_id': 'req-d8bb8276-403b-44d5-8414-bbdd525b6d53'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.098382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:35.101596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:35.109836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] The token cache is being invalidate because project 7f98a5ef75ae47f1afba1b09962e97fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:35.110220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.111133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8bb8276-403b-44d5-8414-bbdd525b6d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:35.113173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 884/1765] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:34 2022] DELETE /identity/v3/projects/7f98a5ef75ae47f1afba1b09962e97fa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:35.118336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b22d-9484-4d8b-b563-58d8f7de38d2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.118787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b22d-9484-4d8b-b563-58d8f7de38d2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.119411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b22d-9484-4d8b-b563-58d8f7de38d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.146140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4284b22d-9484-4d8b-b563-58d8f7de38d2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:35.147422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4284b22d-9484-4d8b-b563-58d8f7de38d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:35.189780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 882/1766] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:35.219316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.222647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:35.241528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 885/1767] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:35.251256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.251693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.252080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.282377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:35.283875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:35.315886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 886/1768] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:35.319890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.336003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:35.342992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9b193-21c9-4060-9945-e2e91c093efb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.352920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.353601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.353895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.354148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.354894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:35.356321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.363644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.383267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 887/1769] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:35.385311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276fba2-a6ad-48bb-9853-edd001da54c6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.388588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.400294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.400294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.400294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.401540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.421860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950acda-6582-4c10-9348-54da783e56b6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.424771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.426113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.435925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.436971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.437341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.437659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.438480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.440594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.462270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 883/1770] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:35.500922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 888/1771] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:35 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:35.504766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.519966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9b32-05f5-4d06-83f6-35eb5942a431 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.614806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.615451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.615737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.616160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.616815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.618791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.644870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 884/1772] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:35 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:35.650298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.661363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a983-c0a6-40fa-bbf1-586ffd10e624 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.670783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.672139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.672521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.673125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.673963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.676620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.690947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 889/1773] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:35.696167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.712905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03d51f-c84e-4ab5-bcbe-5639d35b7d8d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.722584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64115a-47e3-4925-ba9a-b69df5f7f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.723315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64115a-47e3-4925-ba9a-b69df5f7f0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.723639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64115a-47e3-4925-ba9a-b69df5f7f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.723949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64115a-47e3-4925-ba9a-b69df5f7f0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.724726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64115a-47e3-4925-ba9a-b69df5f7f0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.726362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64115a-47e3-4925-ba9a-b69df5f7f0e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.738408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 885/1774] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:35.743025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:35.755037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b99804-8b0b-46ea-8912-fe2431d094a0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:35.761566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:35.762472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.762763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.763050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] PATH_INFO: `/v3/projects/75437f0421f143d6836284e9ad0a54ef/users/e6083079aacf4d62b17e95384bdb4c2c/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.772927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:35.794930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75437f0421f143d6836284e9ad0a54ef, user_id=e6083079aacf4d62b17e95384bdb4c2c, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:35.799557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:35.846152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 890/1775] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:35 2022] PUT /identity/v3/projects/75437f0421f143d6836284e9ad0a54ef/users/e6083079aacf4d62b17e95384bdb4c2c/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:35.858542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:35.858969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:35.859480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:35.942114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] MFA Rules not processed for user `e6083079aacf4d62b17e95384bdb4c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:35.945439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:36.137906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 886/1776] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:36.143458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.226234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcc0be-98c3-44a4-8d25-6c5a46282c77 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:36.235079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:36.235483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.235721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.236161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.237076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:36.239026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:36.276625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 891/1777] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:36 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:36.278210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.290831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a010d9-a88a-4dcd-a7f2-9753a7fd4c80 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:36.360367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:36.377088 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:36.378626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.379016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.379426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.380242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:36.382376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:36.407015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 887/1778] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:36 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:36.411262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.423810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380bce-4150-4632-aba0-e422ea5f92ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:36.431050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:36.432737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.432737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.432737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.433640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:36.435396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:36.452623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 892/1779] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:36.454102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.476293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c2667-0b72-46e0-96c3-ca13b22caa51 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:36.481998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:36.483129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.483517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.484441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] PATH_INFO: `/v3/projects/66eb1327578a473a907d91f6e2865dad/users/61c4eaffe2dc4cfdb4f75fca195aea9e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.506094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66eb1327578a473a907d91f6e2865dad, user_id=61c4eaffe2dc4cfdb4f75fca195aea9e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:36.509126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:36.526048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 888/1780] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:36 2022] PUT /identity/v3/projects/66eb1327578a473a907d91f6e2865dad/users/61c4eaffe2dc4cfdb4f75fca195aea9e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:36.530049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.542511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13883f-dc50-432c-beb8-0d8f66dee957 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:36.618562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9a4a5-f0ef-40ed-a934-83786a692a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:36.619601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9a4a5-f0ef-40ed-a934-83786a692a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.620060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9a4a5-f0ef-40ed-a934-83786a692a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.620543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9a4a5-f0ef-40ed-a934-83786a692a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.621540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9a4a5-f0ef-40ed-a934-83786a692a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:36.624075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9a4a5-f0ef-40ed-a934-83786a692a81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:36.637490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 893/1781] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:36.643289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.654565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e525d54-f2e9-43b8-870a-97ae791e9850 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:36.660973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:36.662016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.662541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.662934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] PATH_INFO: `/v3/projects/66eb1327578a473a907d91f6e2865dad/users/61c4eaffe2dc4cfdb4f75fca195aea9e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.665157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66eb1327578a473a907d91f6e2865dad, user_id=61c4eaffe2dc4cfdb4f75fca195aea9e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:36.668163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:36.687425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 889/1782] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:36 2022] PUT /identity/v3/projects/66eb1327578a473a907d91f6e2865dad/users/61c4eaffe2dc4cfdb4f75fca195aea9e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:36.694195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:36.694598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:36.694975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:36.743037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] MFA Rules not processed for user `61c4eaffe2dc4cfdb4f75fca195aea9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:36.744711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:36.825999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:36.940013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 894/1783] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:36.956238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:36.960354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:37.157571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cf53-24cf-4d97-87e1-fafcfe26c9c2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:37.163762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:37.165202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:37.165683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:37.166148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:37.182258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:37.184211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:37.225257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 890/1784] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:37.503628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:37.506911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:37.662972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6472e3b-26ee-420d-8991-02d02957e23e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:37.673544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:37.675024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:37.675537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:37.675922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] PATH_INFO: `/v3/projects/ed2e717c6b5b49d2934a0ce2015d7f0f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:37.695651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2e717c6b5b49d2934a0ce2015d7f0f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:37.697906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:37.789750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2e717c6b5b49d2934a0ce2015d7f0f', 'request_id': 'req-2c572037-da7d-48b2-943c-867a280cd5ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:37.803794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2e717c6b5b49d2934a0ce2015d7f0f', 'request_id': 'req-2c572037-da7d-48b2-943c-867a280cd5ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:37.814948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2e717c6b5b49d2934a0ce2015d7f0f', 'request_id': 'req-2c572037-da7d-48b2-943c-867a280cd5ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:37.829690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] The token cache is being invalidate because project ed2e717c6b5b49d2934a0ce2015d7f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:37.830274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:37.831579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:37.833440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 895/1785] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:37 2022] DELETE /identity/v3/projects/ed2e717c6b5b49d2934a0ce2015d7f0f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:37.841756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:37.857551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dd126-88e6-4d1b-8646-77722ead3859 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:37.891721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:37.893342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:37.949420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:37.950629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:37.950927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:37.951262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] PATH_INFO: `/v3/users/7f3772da9fe046e1a7b7f804af0a6b7f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:37.953486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3772da9fe046e1a7b7f804af0a6b7f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:37.956244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:38.004159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c572037-da7d-48b2-943c-867a280cd5ab admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:38.019419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c4eaffe2dc4cfdb4f75fca195aea9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66eb1327578a473a907d91f6e2865dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:38.020107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:38.020433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:38.020788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:38.022558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:38.022558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:38.024767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:38.028515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:38.035692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3772da9fe046e1a7b7f804af0a6b7f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.051660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3772da9fe046e1a7b7f804af0a6b7f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.052326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3772da9fe046e1a7b7f804af0a6b7f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.056654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 896/1786] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:09:38.072396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:38.080882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:38.086522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3772da9fe046e1a7b7f804af0a6b7f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.087417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3772da9fe046e1a7b7f804af0a6b7f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.099672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143a751-3ac7-453e-8c18-58a5c2b83b32 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:38.109352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c4eaffe2dc4cfdb4f75fca195aea9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66eb1327578a473a907d91f6e2865dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:38.110534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:38.111522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:38.112216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:38.113222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:38.116019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:38.154175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 891/1787] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:37 2022] DELETE /identity/v3/users/7f3772da9fe046e1a7b7f804af0a6b7f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:38.161082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 897/1788] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:38 2022] POST /identity/v3/projects => generated 354 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:38.165415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:38.166513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:38.263843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b8d8a-6a62-4b4e-a1b9-9858ca4e6a63 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:38.371707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c4eaffe2dc4cfdb4f75fca195aea9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66eb1327578a473a907d91f6e2865dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:38.372840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:38.373217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:38.373585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:38.374487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:38.374887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:38.377622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:38.400193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 892/1789] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:38.499241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:38.520672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ed427-326b-4bca-aa36-eeb3bdc7003a tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:38.536375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c4eaffe2dc4cfdb4f75fca195aea9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66eb1327578a473a907d91f6e2865dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:38.537272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:38.537561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:38.537841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] PATH_INFO: `/v3/projects/e2bb807972d94b3c89d5d7f5de886f3e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:38.540066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2bb807972d94b3c89d5d7f5de886f3e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:38.542009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:38.663781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bb807972d94b3c89d5d7f5de886f3e', 'request_id': 'req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.677533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bb807972d94b3c89d5d7f5de886f3e', 'request_id': 'req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.695325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bb807972d94b3c89d5d7f5de886f3e', 'request_id': 'req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.756741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] The token cache is being invalidate because project e2bb807972d94b3c89d5d7f5de886f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:38.762304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.765438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:38.769416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 898/1790] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:38 2022] DELETE /identity/v3/projects/e2bb807972d94b3c89d5d7f5de886f3e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:38.983456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:38.986451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.105202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6743-528e-48dc-8230-35df37d21386 tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.123073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:39.195507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.197101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.222046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.223431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.223766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.224047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] PATH_INFO: `/v3/projects/fd35555bbe1e4d238e9e827fd7221546` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.225697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd35555bbe1e4d238e9e827fd7221546)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.227656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.277268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8cb4-b699-42b6-8ac1-2a3cd69058ec tempest-VolumeQuotaClassesTest-547339723 tempest-VolumeQuotaClassesTest-547339723-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.282587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd35555bbe1e4d238e9e827fd7221546', 'request_id': 'req-fb837e6c-5c2f-425e-a51e-e90adc9ab926'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.289112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd35555bbe1e4d238e9e827fd7221546', 'request_id': 'req-fb837e6c-5c2f-425e-a51e-e90adc9ab926'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.295114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd35555bbe1e4d238e9e827fd7221546', 'request_id': 'req-fb837e6c-5c2f-425e-a51e-e90adc9ab926'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.308558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] The token cache is being invalidate because project fd35555bbe1e4d238e9e827fd7221546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:39.308847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.309469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb837e6c-5c2f-425e-a51e-e90adc9ab926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.311036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 893/1791] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:38 2022] DELETE /identity/v3/projects/fd35555bbe1e4d238e9e827fd7221546 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:39.317598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c11e-22f5-47e8-b06f-90a548706d9e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.317900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c11e-22f5-47e8-b06f-90a548706d9e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.318189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c11e-22f5-47e8-b06f-90a548706d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.336879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9c26c11e-22f5-47e8-b06f-90a548706d9e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:39.338395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.338570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9c26c11e-22f5-47e8-b06f-90a548706d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.338876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.339192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.339473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] PATH_INFO: `/v3/users/e6083079aacf4d62b17e95384bdb4c2c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.340693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6083079aacf4d62b17e95384bdb4c2c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.342635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.346516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 894/1792] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:39.354991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.355318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.355605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.356263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:39.375638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:39.376849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.385358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 895/1793] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:39.389248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.393810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6083079aacf4d62b17e95384bdb4c2c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.394472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6083079aacf4d62b17e95384bdb4c2c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.398543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572185a-8164-4e4d-a176-46d5fb3b0e69 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.402249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6083079aacf4d62b17e95384bdb4c2c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.402891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6083079aacf4d62b17e95384bdb4c2c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.403871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.404535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.404901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.405106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.405898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:39.406211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.408005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.411440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a18acb5f-755a-4b87-b3bb-4f73325ad5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6083079aacf4d62b17e95384bdb4c2c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:39.420035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 896/1794] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:09:39.424948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.426674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.431547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 899/1795] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:39 2022] DELETE /identity/v3/users/e6083079aacf4d62b17e95384bdb4c2c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:39.435870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845091c-257d-4018-8c64-1246cf57296f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.436164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845091c-257d-4018-8c64-1246cf57296f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.436440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845091c-257d-4018-8c64-1246cf57296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.440423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f91303-30ca-4a42-b1c3-890e8ae481bf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.454476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c845091c-257d-4018-8c64-1246cf57296f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:39.455727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c845091c-257d-4018-8c64-1246cf57296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.508703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.509646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.509646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.510101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.510796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.512776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.525983 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 900/1796] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:39.534265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:39.536312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845091c-257d-4018-8c64-1246cf57296f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.538586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c845091c-257d-4018-8c64-1246cf57296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.551928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 897/1797] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:39.553646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.610101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845091c-257d-4018-8c64-1246cf57296f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.626233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73fcd-009a-42eb-a4e5-5accc014cbdf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.631561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.632283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.632579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.632864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.633572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.635625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.662572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:39.672844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.673486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.673734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 898/1798] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:39.673889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.674281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.675659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.686305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.688665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.691969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1238-aec2-423e-9a98-1632c5fc8217 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.698803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.699465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 901/1799] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:09:39.699637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.700114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.700459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.701219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.703812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.720357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 899/1800] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:39.724412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.734776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f59938-2368-4447-9182-f0d2fef265d7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.739820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2ee6-4232-4f34-8835-c27912dd5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.740504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2ee6-4232-4f34-8835-c27912dd5760 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.740797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2ee6-4232-4f34-8835-c27912dd5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.741082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2ee6-4232-4f34-8835-c27912dd5760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.741821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2ee6-4232-4f34-8835-c27912dd5760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.743484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2ee6-4232-4f34-8835-c27912dd5760 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.755804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 902/1801] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:39.760477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:39.774793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13bc4-6d19-4019-b6c5-463b8251f776 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:39.783387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:39.784937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.785419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.786424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] PATH_INFO: `/v3/projects/c57e9fb49d4a4fb1bc54a0610d996f56/users/c84a90e16bac4370a653350e6786e5af/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.807943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57e9fb49d4a4fb1bc54a0610d996f56, user_id=c84a90e16bac4370a653350e6786e5af, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:39.811489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:39.827274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 900/1802] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:39 2022] PUT /identity/v3/projects/c57e9fb49d4a4fb1bc54a0610d996f56/users/c84a90e16bac4370a653350e6786e5af/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:39.840272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:39.840892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:39.841340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:39.876483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] MFA Rules not processed for user `c84a90e16bac4370a653350e6786e5af`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:39.877723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:39.985324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 903/1803] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:39.992265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.087139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c700f-fc6a-4cb6-bed1-9bba8cbbe6d4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.092703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.093458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.093786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.094216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.094929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.097064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.113399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.116867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.130869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 901/1804] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:39 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:40.134879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc1861-07a8-489c-8601-2d7de65c94da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.135030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.210753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:40.213155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.214297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.214603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.214859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] PATH_INFO: `/v3/projects/75437f0421f143d6836284e9ad0a54ef` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.216996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=75437f0421f143d6836284e9ad0a54ef)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.220508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.240375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82e60e-e39a-4c25-a304-44d0bdab4fa8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.251713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.252482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.252702 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.252981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.253676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.255972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.286362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75437f0421f143d6836284e9ad0a54ef', 'request_id': 'req-2451e824-8c64-4ae3-96fa-d4ee2947dbae'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.298601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 902/1805] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:40 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:40.302233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.304245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75437f0421f143d6836284e9ad0a54ef', 'request_id': 'req-2451e824-8c64-4ae3-96fa-d4ee2947dbae'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.313991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75437f0421f143d6836284e9ad0a54ef', 'request_id': 'req-2451e824-8c64-4ae3-96fa-d4ee2947dbae'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.315543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482392d-737c-4c8b-93fc-888308b2e747 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.322715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:40.331792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] The token cache is being invalidate because project 75437f0421f143d6836284e9ad0a54ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:40.332148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.332879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.334995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 904/1806] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:40 2022] DELETE /identity/v3/projects/75437f0421f143d6836284e9ad0a54ef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:40.340192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.341784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.393575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.394272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.394639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.394818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.395735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.397681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.412146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 903/1807] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:40.419281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.422116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.435718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a0eb9-f296-4f87-bdd4-f75e9573abe7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.442460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.443486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.443841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.444191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] PATH_INFO: `/v3/projects/1206f2a70e6844309eb5a8ee8266ac59/users/c62d63b0846842039ccf0aba693ecdaa/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.451914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e824-8c64-4ae3-96fa-d4ee2947dbae admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.457975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.459134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.459357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.459671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] PATH_INFO: `/v3/users/61c4eaffe2dc4cfdb4f75fca195aea9e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.460940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c4eaffe2dc4cfdb4f75fca195aea9e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.461690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1206f2a70e6844309eb5a8ee8266ac59, user_id=c62d63b0846842039ccf0aba693ecdaa, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.462924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.464619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.483118 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 904/1808] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:40 2022] PUT /identity/v3/projects/1206f2a70e6844309eb5a8ee8266ac59/users/c62d63b0846842039ccf0aba693ecdaa/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:40.487359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.518367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c4eaffe2dc4cfdb4f75fca195aea9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.519166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c4eaffe2dc4cfdb4f75fca195aea9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.526977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c4eaffe2dc4cfdb4f75fca195aea9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.527697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c4eaffe2dc4cfdb4f75fca195aea9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.536893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c4eaffe2dc4cfdb4f75fca195aea9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:40.555951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 905/1809] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:40 2022] DELETE /identity/v3/users/61c4eaffe2dc4cfdb4f75fca195aea9e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:40.565676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a775-9234-4ea6-9e1f-e6721ce46c5f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.625919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:40.639845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32a130-fbde-4b83-a7b6-c319ac361044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.640770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32a130-fbde-4b83-a7b6-c319ac361044 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.641062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32a130-fbde-4b83-a7b6-c319ac361044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.641345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32a130-fbde-4b83-a7b6-c319ac361044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.642089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32a130-fbde-4b83-a7b6-c319ac361044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.643734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32a130-fbde-4b83-a7b6-c319ac361044 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.654136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 905/1810] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:40.658786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.660257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.675074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbbabf-00d7-4265-b8ad-2c9e876e1483 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.680556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.681460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.681745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.682030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] PATH_INFO: `/v3/projects/1206f2a70e6844309eb5a8ee8266ac59/users/c62d63b0846842039ccf0aba693ecdaa/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.684056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1206f2a70e6844309eb5a8ee8266ac59, user_id=c62d63b0846842039ccf0aba693ecdaa, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.687341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.698030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 906/1811] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:40 2022] PUT /identity/v3/projects/1206f2a70e6844309eb5a8ee8266ac59/users/c62d63b0846842039ccf0aba693ecdaa/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:40.709192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.709492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.709773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.741795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] MFA Rules not processed for user `c62d63b0846842039ccf0aba693ecdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:40.743079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.825579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 906/1812] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:40.836813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.838601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.911068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084ec8-8427-4606-8b0e-a7bf98832d56 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:40.915562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:40.916225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:40.917179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:40.917179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:40.929432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:40.932082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:40.936222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:40.937717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:40.946783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 907/1813] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:41.033941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.038620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3a3fa-86b1-4805-83d9-071291acbd40 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.044430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132ea8-129b-4032-81aa-e395cc4d1eca service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.047626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.048519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.048641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.048842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.049078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] PATH_INFO: `/v3/projects/66eb1327578a473a907d91f6e2865dad` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.049174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.049451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.049735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.050329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=66eb1327578a473a907d91f6e2865dad)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.051678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:41.052537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.057204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:41.117309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66eb1327578a473a907d91f6e2865dad', 'request_id': 'req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:41.125687 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66eb1327578a473a907d91f6e2865dad', 'request_id': 'req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:41.133467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66eb1327578a473a907d91f6e2865dad', 'request_id': 'req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:41.146538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:41.151855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] The token cache is being invalidate because project 66eb1327578a473a907d91f6e2865dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:41.152640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:41.153583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4a94f5c8-7ee2-43ea-883a-0cc8a642fbaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:41.156404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 907/1814] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:40 2022] DELETE /identity/v3/projects/66eb1327578a473a907d91f6e2865dad => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:41.161492 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.161856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.163200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.184032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:41.185278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:41.261480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.263660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174561c-e294-4fbf-90f5-4ac9b00adc56 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.282258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 908/1815] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:09:41.282566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 908/1816] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:41.284222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.284513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.284776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.310756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:41.314042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:41.331265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 909/1817] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:41.332810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.346822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff617b-06ef-4461-bf6a-996eb87b8448 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.355027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.355747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.356039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.356316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.357056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:41.357367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.360886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.378046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 909/1818] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:41.382291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.397650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace32b7-46f3-49ad-a8ad-b2cbfaf31e06 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.404629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.407731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.408129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.408506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.409641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.412820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.450378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 910/1819] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:41 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:41.455559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.466223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cb48-483e-4362-8890-2ce8971c721c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.565997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.566663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.566961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.567282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.568015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.570457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.599637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 910/1820] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:41 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:41.603984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.615409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690487-6d67-4ad2-baae-13b07297cac1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.621460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.622242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.622636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.623014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.623903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.625815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.642332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 911/1821] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:41.643070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.654395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f3c6-d38a-4eb1-8eef-a2cce369da3a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.660488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f671da-aab5-47cb-bd5b-3dfa5c370f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.661305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f671da-aab5-47cb-bd5b-3dfa5c370f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.661596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f671da-aab5-47cb-bd5b-3dfa5c370f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.661879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f671da-aab5-47cb-bd5b-3dfa5c370f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.662615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f671da-aab5-47cb-bd5b-3dfa5c370f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.664255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f671da-aab5-47cb-bd5b-3dfa5c370f9c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.678136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 911/1822] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:41.682219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.702698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec810-feaf-4b34-ae74-1f3f9c365456 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.708238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.709759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.710057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.710329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] PATH_INFO: `/v3/projects/c4de3faa2e1944eaae029dcd6536398a/users/e5c4640539f34781ace74990d80ec9a4/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.738316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4de3faa2e1944eaae029dcd6536398a, user_id=e5c4640539f34781ace74990d80ec9a4, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.740505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:41.760316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 912/1823] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:41 2022] PUT /identity/v3/projects/c4de3faa2e1944eaae029dcd6536398a/users/e5c4640539f34781ace74990d80ec9a4/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:41.776502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.776907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.777359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.823006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] MFA Rules not processed for user `e5c4640539f34781ace74990d80ec9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:41.825962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:41.894314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:41.905823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 912/1824] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:41.917225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:41.919297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:41.979862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec725d-13a0-474e-8427-d193ffa27948 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:41.984308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b48bd2-2a64-4857-b50e-5f801933cca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:41.984924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b48bd2-2a64-4857-b50e-5f801933cca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:41.985209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b48bd2-2a64-4857-b50e-5f801933cca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:41.985487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b48bd2-2a64-4857-b50e-5f801933cca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:41.994433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b48bd2-2a64-4857-b50e-5f801933cca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:41.995892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b48bd2-2a64-4857-b50e-5f801933cca8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:42.005720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 913/1825] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:44.161868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:44.163423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:44.234004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf627a-dc32-4d0c-870f-bbac2f590769 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:44.240227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:44.241160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:44.241453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:44.241736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] PATH_INFO: `/v3/users/c84a90e16bac4370a653350e6786e5af` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:44.242974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84a90e16bac4370a653350e6786e5af)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:44.244967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:44.295608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84a90e16bac4370a653350e6786e5af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:44.309181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84a90e16bac4370a653350e6786e5af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:44.309827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84a90e16bac4370a653350e6786e5af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:44.325425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84a90e16bac4370a653350e6786e5af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:44.325565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84a90e16bac4370a653350e6786e5af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:44.341860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 913/1826] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:44 2022] DELETE /identity/v3/users/c84a90e16bac4370a653350e6786e5af => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:44.346874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:44.347424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:44.347599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:44.377045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:44.378259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:44.420805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:44.447274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 914/1827] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:44.457388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:44.458810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:44.519526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433524-d135-4067-a6e9-7f99678aa297 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:44.523104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:44.524016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:44.524299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:44.524575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:44.534359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:44.535836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:44.545604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 914/1828] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:44.829946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:44.831436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:44.845327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695510-4cca-4ace-a1e1-ddc3f57956e5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:44.853522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:44.854745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:44.855030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:44.855504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] PATH_INFO: `/v3/projects/c57e9fb49d4a4fb1bc54a0610d996f56` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:44.867752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57e9fb49d4a4fb1bc54a0610d996f56)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:44.870461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:44.962245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57e9fb49d4a4fb1bc54a0610d996f56', 'request_id': 'req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.004999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57e9fb49d4a4fb1bc54a0610d996f56', 'request_id': 'req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.045196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57e9fb49d4a4fb1bc54a0610d996f56', 'request_id': 'req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.062927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] The token cache is being invalidate because project c57e9fb49d4a4fb1bc54a0610d996f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:45.063938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.064829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.067138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 915/1829] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:44 2022] DELETE /identity/v3/projects/c57e9fb49d4a4fb1bc54a0610d996f56 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:45.082360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:45.101365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f597-26ed-4b38-96bc-91bad666b4c2 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:45.108130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:45.113033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:45.138484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:45.259690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:45.262454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:45.262984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:45.263402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] PATH_INFO: `/v3/users/c62d63b0846842039ccf0aba693ecdaa` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:45.265151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62d63b0846842039ccf0aba693ecdaa)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:45.268076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:45.364049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfd004-7d2f-4ef6-9d3a-3ef77e28d041 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:45.376616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:45.378247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:45.378878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:45.379618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] PATH_INFO: `/v3/users/e5c4640539f34781ace74990d80ec9a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:45.381513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c4640539f34781ace74990d80ec9a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:45.384003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:45.427144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62d63b0846842039ccf0aba693ecdaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.451746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62d63b0846842039ccf0aba693ecdaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.453012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62d63b0846842039ccf0aba693ecdaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.478519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62d63b0846842039ccf0aba693ecdaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.479593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-38bf8c2b-87ea-4db5-adb7-786dbb5b09c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62d63b0846842039ccf0aba693ecdaa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.490325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c4640539f34781ace74990d80ec9a4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.491451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c4640539f34781ace74990d80ec9a4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.502958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c4640539f34781ace74990d80ec9a4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.504001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c4640539f34781ace74990d80ec9a4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.521702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c4640539f34781ace74990d80ec9a4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:45.522592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 915/1830] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:45 2022] DELETE /identity/v3/users/c62d63b0846842039ccf0aba693ecdaa => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:45.531463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:45.556835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 916/1831] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:45 2022] DELETE /identity/v3/users/e5c4640539f34781ace74990d80ec9a4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:45.558467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:45.558763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:45.559041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:45.589004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:45.591667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:45.674488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 916/1832] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:45.686139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:45.690053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:45.781575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a367e1-55dc-4dd4-af08-1f3d5cb80faa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:45.785925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7610f-f56a-4e0c-9044-d351df372591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:45.786595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7610f-f56a-4e0c-9044-d351df372591 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:45.786877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7610f-f56a-4e0c-9044-d351df372591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:45.787249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7610f-f56a-4e0c-9044-d351df372591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:45.798842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7610f-f56a-4e0c-9044-d351df372591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:45.800237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7610f-f56a-4e0c-9044-d351df372591 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:45.810972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 917/1833] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:45.959873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:45.961392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:45.977545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c53e-648d-4494-8b68-ac573e451f4e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:45.983950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:45.983950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:45.984293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:45.984743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] PATH_INFO: `/v3/projects/1206f2a70e6844309eb5a8ee8266ac59` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:45.986046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1206f2a70e6844309eb5a8ee8266ac59)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:45.988468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.048882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:46.067249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1206f2a70e6844309eb5a8ee8266ac59', 'request_id': 'req-c6520adb-afa3-41cd-96ea-3e30e5081767'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.073961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1206f2a70e6844309eb5a8ee8266ac59', 'request_id': 'req-c6520adb-afa3-41cd-96ea-3e30e5081767'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.081797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1206f2a70e6844309eb5a8ee8266ac59', 'request_id': 'req-c6520adb-afa3-41cd-96ea-3e30e5081767'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.099959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] The token cache is being invalidate because project 1206f2a70e6844309eb5a8ee8266ac59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:46.100419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.101452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.103124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 917/1834] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:45 2022] DELETE /identity/v3/projects/1206f2a70e6844309eb5a8ee8266ac59 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:46.108410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6076e-78fa-4ca5-83ac-e59c89ec881b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.108626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6076e-78fa-4ca5-83ac-e59c89ec881b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.109011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6076e-78fa-4ca5-83ac-e59c89ec881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.131230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c4c6076e-78fa-4ca5-83ac-e59c89ec881b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:46.132841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4c6076e-78fa-4ca5-83ac-e59c89ec881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.160090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.161686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.241100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 918/1835] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:46.243387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.243387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.243621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.249596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520adb-afa3-41cd-96ea-3e30e5081767 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.256193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.257499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.257499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.257853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] PATH_INFO: `/v3/projects/c4de3faa2e1944eaae029dcd6536398a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.259752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4de3faa2e1944eaae029dcd6536398a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.262034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.264125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:46.266210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.274352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 919/1836] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:46.278826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.289874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4fa37-f5ed-4b02-88bb-b42b5afcdecf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.294570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.295270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.295556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.296834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.298087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:46.298399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.300037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.317454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 920/1837] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:09:46.321335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.333484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1697da-7d76-4a55-8c02-824c93d70da8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.335401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4de3faa2e1944eaae029dcd6536398a', 'request_id': 'req-bda1e592-b839-478a-8f68-7ac8af503a5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.343724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4de3faa2e1944eaae029dcd6536398a', 'request_id': 'req-bda1e592-b839-478a-8f68-7ac8af503a5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.351383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4de3faa2e1944eaae029dcd6536398a', 'request_id': 'req-bda1e592-b839-478a-8f68-7ac8af503a5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.368684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] The token cache is being invalidate because project c4de3faa2e1944eaae029dcd6536398a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:46.369061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.371324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bda1e592-b839-478a-8f68-7ac8af503a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:46.373365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 918/1838] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:46 2022] DELETE /identity/v3/projects/c4de3faa2e1944eaae029dcd6536398a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:46.379825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750f11a-897e-482d-986e-6e7e563c0133 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.380200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750f11a-897e-482d-986e-6e7e563c0133 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.380550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750f11a-897e-482d-986e-6e7e563c0133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.403232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.403915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.404199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.404478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.405850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.408396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e750f11a-897e-482d-986e-6e7e563c0133 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:46.408549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.409993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e750f11a-897e-482d-986e-6e7e563c0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.425083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 919/1839] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:46.432399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.432700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.432986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.434629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:46.452166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 921/1840] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:46.452747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:46.453402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.453963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.455316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.495510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:46.520293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 920/1841] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:46.521252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.526308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dad625-ea3a-45fe-ade3-c669b0c2273c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.531067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9bad-e754-42cc-b6e7-829c23ba7bf4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.531942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.532687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.532984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.533250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.533941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.535877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.535982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.536631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.536923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.537202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.537947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:09:46.538261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.539917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.554029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 921/1842] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:09:46.558077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.559643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 922/1843] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:46.563695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.569656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b508-80c6-4f97-91dd-fc8639f375f2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.574023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9232c-e14a-4915-bd1e-544472437757 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.575559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.576227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.576518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.576796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.578273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.580483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.581233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.581914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.582206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.582489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.583283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.584883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.598993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 923/1844] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:46.600172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.611244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edcaad-a5ed-4ee3-a333-5f3fba12c44c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.614425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 922/1845] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:46.617075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.617695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.617980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.618258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.618462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.618990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.621638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.634742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 924/1846] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:46.635821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.647631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d6042-82b4-4a0e-bc48-ebbde416f00b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.693100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9356f2-954c-4f6d-a9ee-eef0208e133e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.698512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.699230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.699531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.699819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.700520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.703167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.720239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0829577-752b-4fbc-8272-483ebe921416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.721175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0829577-752b-4fbc-8272-483ebe921416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.721527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0829577-752b-4fbc-8272-483ebe921416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.721785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0829577-752b-4fbc-8272-483ebe921416 admin admin] PATH_INFO: `/v3/projects/e940c850c6a34cdfbf5fd9a475cefb35/users/f4313ba85f584d91adff8a3c4b818426/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.729811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 923/1847] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:09:46.734981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.740971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0829577-752b-4fbc-8272-483ebe921416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e940c850c6a34cdfbf5fd9a475cefb35, user_id=f4313ba85f584d91adff8a3c4b818426, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.743761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0829577-752b-4fbc-8272-483ebe921416 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.749225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3d20c-7c71-4cf6-8bce-bbbc6bcf601b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.754486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.755188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.755481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.755772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.756512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.758133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.758993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 925/1848] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:46 2022] PUT /identity/v3/projects/e940c850c6a34cdfbf5fd9a475cefb35/users/f4313ba85f584d91adff8a3c4b818426/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:46.772756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 924/1849] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:09:46.773498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.773498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.773498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.775393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.791866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5843-76d8-4af4-9f34-6793f36ca655 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.804239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] MFA Rules not processed for user `f4313ba85f584d91adff8a3c4b818426`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:46.805552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:46.843491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:46.861357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.862074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.862361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.862645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.863574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.865175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.880524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 925/1850] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:46.885611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.895962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 926/1851] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:46.900597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.906338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff741f-0937-481d-a71f-214d336fc538 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.913141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac66c-7316-4692-88f5-5abc10ec0a86 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:46.913349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d727df-fe19-4246-b646-1b93244b82b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.914246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d727df-fe19-4246-b646-1b93244b82b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.914545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d727df-fe19-4246-b646-1b93244b82b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.915169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d727df-fe19-4246-b646-1b93244b82b6 admin admin] PATH_INFO: `/v3/projects/9ef609a59f4f4d6393eda7f49d5a34bf/users/943009da34fd4d49942bfff02680b476/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.918790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:46.920551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.921660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.922109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:46.922920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.925024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.934541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d727df-fe19-4246-b646-1b93244b82b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef609a59f4f4d6393eda7f49d5a34bf, user_id=943009da34fd4d49942bfff02680b476, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:46.939949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d727df-fe19-4246-b646-1b93244b82b6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:46.954342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:46.958569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 927/1852] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:46.959689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 926/1853] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:46 2022] PUT /identity/v3/projects/9ef609a59f4f4d6393eda7f49d5a34bf/users/943009da34fd4d49942bfff02680b476/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:46.962426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:46.970762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:46.971170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:46.971584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.007012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] MFA Rules not processed for user `943009da34fd4d49942bfff02680b476`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:47.008485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:47.041370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2b94d-1c5f-4ade-952a-e92038087fa2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.048654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.049458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.049848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.050234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.051427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.054270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.089970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 928/1854] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:09:47.094584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.110391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49940cd3-ad33-449d-ad09-dfa027969602 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.114663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 927/1855] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:47.119011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.119726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.120014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.120297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.121363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.122641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.126771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.128309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:47.135378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 929/1856] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:47.139459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.150447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f2b11-6a3a-489f-b826-ca94972ae924 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.156847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.157819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.158101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.158378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] PATH_INFO: `/v3/projects/068e589dfdae4384914b6644f2961b51/users/19b0397623ee4923873f0ce035d2c285/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.174499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] RBAC: Authorizing `identity:create_grant(project_id=068e589dfdae4384914b6644f2961b51, user_id=19b0397623ee4923873f0ce035d2c285, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.177186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.192147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9381d-f64b-4189-91dd-8d6b597fd82f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.193734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 930/1857] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:47 2022] PUT /identity/v3/projects/068e589dfdae4384914b6644f2961b51/users/19b0397623ee4923873f0ce035d2c285/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:47.197782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.245014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f631-b0a5-4cf3-a91f-48387d3cfbe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.245952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f631-b0a5-4cf3-a91f-48387d3cfbe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.246381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f631-b0a5-4cf3-a91f-48387d3cfbe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.246665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f631-b0a5-4cf3-a91f-48387d3cfbe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.269846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f4d9-b207-426a-aa9c-fd7e8728616f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.274951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.275663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.275950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.276229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.276963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.278616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.289075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 931/1858] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:09:47.293576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.299936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:47.303885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89600a-750e-4f9c-809b-dbe76c093d67 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.308534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f631-b0a5-4cf3-a91f-48387d3cfbe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.310215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f631-b0a5-4cf3-a91f-48387d3cfbe3 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.310741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.312332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.312587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.312956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] PATH_INFO: `/v3/projects/068e589dfdae4384914b6644f2961b51/users/19b0397623ee4923873f0ce035d2c285/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.315154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068e589dfdae4384914b6644f2961b51, user_id=19b0397623ee4923873f0ce035d2c285, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.317178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:47.317844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.322496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 928/1859] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:09:47.332772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 932/1860] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:09:47 2022] PUT /identity/v3/projects/068e589dfdae4384914b6644f2961b51/users/19b0397623ee4923873f0ce035d2c285/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:09:47.344649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.345023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.345448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.373776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] MFA Rules not processed for user `19b0397623ee4923873f0ce035d2c285`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:47.376078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:47.461679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 929/1861] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:47.497053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.500191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:47.595037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367efc-6c5a-4713-a844-fe023b4f7e38 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.599449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.600212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.600575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.600928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.612487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.614035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.645366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 933/1862] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:47.689498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:47.698983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d54e19-bae5-42b4-b760-d952d0e01a09 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:47.702887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:47.703586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:47.703879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:47.704162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:47.771004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:47.772528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:47.783210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 930/1863] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:57.620065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:57.777805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=62 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:58.402182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:58.481441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcae09-c8dd-4e88-986c-cb1b4805d13e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:58.488235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:58.489187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:58.489536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:58.489737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] PATH_INFO: `/v3/users/943009da34fd4d49942bfff02680b476` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:58.491011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=943009da34fd4d49942bfff02680b476)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:58.494013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:58.527187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:58.543934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5aa1f-dbd4-4fbf-85a3-d203b6ac1979 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:58.549670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:58.550666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:58.551025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:58.551413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] PATH_INFO: `/v3/users/f4313ba85f584d91adff8a3c4b818426` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:58.552665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4313ba85f584d91adff8a3c4b818426)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:58.554812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:58.559593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943009da34fd4d49942bfff02680b476'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.560290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943009da34fd4d49942bfff02680b476'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.573118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943009da34fd4d49942bfff02680b476'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.574709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943009da34fd4d49942bfff02680b476'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.584532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e003a513-d8a9-4564-9273-db1e0c053bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943009da34fd4d49942bfff02680b476'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.607024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 934/1864] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:58 2022] DELETE /identity/v3/users/943009da34fd4d49942bfff02680b476 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:58.612294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:58.612660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:58.613025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:58.614722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4313ba85f584d91adff8a3c4b818426'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.625612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4313ba85f584d91adff8a3c4b818426'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.626382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4313ba85f584d91adff8a3c4b818426'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.633510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:58.634813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:58.643942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4313ba85f584d91adff8a3c4b818426'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.644707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c5b562e4-0358-48db-a9dd-07660fc17cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4313ba85f584d91adff8a3c4b818426'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:58.661172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 931/1865] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:58 2022] DELETE /identity/v3/users/f4313ba85f584d91adff8a3c4b818426 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:58.665603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:58.665603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:58.665902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:58.684958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:58.686299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:58.707738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 935/1866] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:58.721918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:58.728347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:58.754296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:58.757924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 932/1867] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:09:58.766531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:58.768314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:58.832096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f197c6-a174-4a93-8595-76bdbb6fea88 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:58.859874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6f85c-83f8-482c-adfe-81078a4f69dd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:58.863948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:58.864620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:58.864901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:58.865176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:58.880212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:58.881850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:58.897865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:58.899002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:58.900698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:58.901043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:58.902986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 933/1868] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:58.913578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:58.915133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:58.931999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 936/1869] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:09:59.413836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:59.415337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:59.433045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b726fc-c0bc-4fd2-bc03-788842919606 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:59.440099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:59.441244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:59.441528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:59.441808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] PATH_INFO: `/v3/projects/e940c850c6a34cdfbf5fd9a475cefb35` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:59.443074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e940c850c6a34cdfbf5fd9a475cefb35)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:59.445300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:59.459627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:59.548523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e940c850c6a34cdfbf5fd9a475cefb35', 'request_id': 'req-0522f414-0399-4abf-80db-42c404f44919'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.561914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e940c850c6a34cdfbf5fd9a475cefb35', 'request_id': 'req-0522f414-0399-4abf-80db-42c404f44919'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.563285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:59.564956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:59.570189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e940c850c6a34cdfbf5fd9a475cefb35', 'request_id': 'req-0522f414-0399-4abf-80db-42c404f44919'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.600456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6029b8-cf1c-4ed1-a182-95c2dc865567 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:59.601467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] The token cache is being invalidate because project e940c850c6a34cdfbf5fd9a475cefb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:59.601710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.602402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.605108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 934/1870] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:59 2022] DELETE /identity/v3/projects/e940c850c6a34cdfbf5fd9a475cefb35 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:59.610603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:09:59.612117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:59.688742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:59.689789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:59.690089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:59.690359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] PATH_INFO: `/v3/projects/9ef609a59f4f4d6393eda7f49d5a34bf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:59.691627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef609a59f4f4d6393eda7f49d5a34bf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:59.693533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:59.709689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522f414-0399-4abf-80db-42c404f44919 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:09:59.722625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:09:59.724026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:59.725266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:59.726249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] PATH_INFO: `/v3/users/19b0397623ee4923873f0ce035d2c285` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:59.728136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b0397623ee4923873f0ce035d2c285)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:09:59.731733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:09:59.786084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef609a59f4f4d6393eda7f49d5a34bf', 'request_id': 'req-a2d8e95d-f038-4140-b5bc-70341b6bd99a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.801311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef609a59f4f4d6393eda7f49d5a34bf', 'request_id': 'req-a2d8e95d-f038-4140-b5bc-70341b6bd99a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.813315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef609a59f4f4d6393eda7f49d5a34bf', 'request_id': 'req-a2d8e95d-f038-4140-b5bc-70341b6bd99a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.828005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] The token cache is being invalidate because project 9ef609a59f4f4d6393eda7f49d5a34bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:09:59.828569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.829346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a2d8e95d-f038-4140-b5bc-70341b6bd99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.831464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 937/1871] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:09:59 2022] DELETE /identity/v3/projects/9ef609a59f4f4d6393eda7f49d5a34bf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:59.837472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:59.838213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:59.838679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:59.864197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b0397623ee4923873f0ce035d2c285'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.868750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:59.869478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:09:59.875811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:59.878366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b0397623ee4923873f0ce035d2c285'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.881527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b0397623ee4923873f0ce035d2c285'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.899579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b0397623ee4923873f0ce035d2c285'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.900350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7f6b38d-9f2e-41c0-b59f-f703edc9110e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b0397623ee4923873f0ce035d2c285'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:09:59.917081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 935/1872] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:09:59 2022] DELETE /identity/v3/users/19b0397623ee4923873f0ce035d2c285 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:09:59.946881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 938/1873] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:09:59.956769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:09:59.957064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:09:59.957349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:09:59.995365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:09:59.997205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:00.016779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:00.127979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 936/1874] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:00.140198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.151391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8355c-2590-43dd-9ce2-b9d6b7c0eaf2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.157842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.158816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.159027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.159444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.160291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:00.160696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.162418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.181732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.182935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 939/1875] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:00.213576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dac7b9-7cea-49bb-bca7-e4659d89bbe1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.231451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.232626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.233499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.233818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.234703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.240674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.298670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 937/1876] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:00.302687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.316771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b8dae-ad44-4c69-95d3-d35d8d5bebe6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.394107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.395967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:00.425225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.426681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.426975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.429337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.430494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.433495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.467142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 940/1877] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:00.472219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.483867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3f28f-fd99-45cc-ac05-b580802cbed1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.490064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.490829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.491528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.491823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.492565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.494174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.508851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 941/1878] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:00.511439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20113b1d-b570-467f-8fd9-6e51e31637b4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.513229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.519045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.520796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.520917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.521254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] PATH_INFO: `/v3/projects/068e589dfdae4384914b6644f2961b51` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.522597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068e589dfdae4384914b6644f2961b51)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.525154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.525728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e08cf-ed32-4b2c-b697-15e6d5a71a9a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.531631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.532359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.532651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.532938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.533700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.535595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.550795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 942/1879] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:00.554539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.567138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f274adf-6e14-4010-9da0-e6ced683c029 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.573913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c40335-03b2-4cb9-8ef3-a514aa809f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.575477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c40335-03b2-4cb9-8ef3-a514aa809f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.575929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c40335-03b2-4cb9-8ef3-a514aa809f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.576225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c40335-03b2-4cb9-8ef3-a514aa809f37 admin admin] PATH_INFO: `/v3/projects/745158bf86bc45898da2b6cda424ba0d/users/91083c1ab27f463685e95c5acb865673/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.590676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068e589dfdae4384914b6644f2961b51', 'request_id': 'req-84754814-30c7-4855-87b6-a6ea019824a8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:00.597843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068e589dfdae4384914b6644f2961b51', 'request_id': 'req-84754814-30c7-4855-87b6-a6ea019824a8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:00.598291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c40335-03b2-4cb9-8ef3-a514aa809f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745158bf86bc45898da2b6cda424ba0d, user_id=91083c1ab27f463685e95c5acb865673, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.601725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c40335-03b2-4cb9-8ef3-a514aa809f37 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.607486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068e589dfdae4384914b6644f2961b51', 'request_id': 'req-84754814-30c7-4855-87b6-a6ea019824a8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:00.619590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 943/1880] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:00 2022] PUT /identity/v3/projects/745158bf86bc45898da2b6cda424ba0d/users/91083c1ab27f463685e95c5acb865673/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:00.631246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.631610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.632011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.632516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] The token cache is being invalidate because project 068e589dfdae4384914b6644f2961b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:00.632850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:00.633632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-84754814-30c7-4855-87b6-a6ea019824a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:00.635546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 938/1881] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:00 2022] DELETE /identity/v3/projects/068e589dfdae4384914b6644f2961b51 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:00.641401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5181-f500-4449-9c61-3963ff7dcef4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.641957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5181-f500-4449-9c61-3963ff7dcef4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.642328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5181-f500-4449-9c61-3963ff7dcef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.663335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0f8f5181-f500-4449-9c61-3963ff7dcef4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:00.663679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] MFA Rules not processed for user `91083c1ab27f463685e95c5acb865673`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:00.664896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:00.665032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0f8f5181-f500-4449-9c61-3963ff7dcef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:00.689125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:00.704669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:00.741196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 939/1882] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:00.751058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.751274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.751450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.755234 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 944/1883] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:00.768524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.770316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:00.782308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:00.783301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:00.796746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 940/1884] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:00.797738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.809227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f66b8-8186-498e-9667-726b66b9d6dc None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.814300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.815054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.816154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.816458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.817429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:00.817643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.819441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.837009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 941/1885] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:00.837212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff36ef9-e4a6-4c4b-bda6-91ad85480aa6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.838312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.840257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.840952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.841238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.841516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.850243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31ec7-ea9d-41d8-986d-9ba67e90e532 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.852502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.854532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.856805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.857558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.858575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.858965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.859851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.862120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:00.866018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 945/1886] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:00.893911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 942/1887] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:00.897875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:00.911543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d283ec-afd3-47c7-8ab4-540deb687610 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:00.983629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:00.984493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:00.984886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:00.985191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:00.985976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:00.988227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.019284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 946/1888] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:00 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:01.020623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.032584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe0a3e-5336-4350-9251-d00ce25e7043 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.041026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.041725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.042030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.042362 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.043157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.044963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.059126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 943/1889] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:01.063854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.074991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d0a6-30d5-4a18-adc1-96b5f53819fe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.081626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9bcc3-3a7d-42c0-9720-f8a7bc0a45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.082499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9bcc3-3a7d-42c0-9720-f8a7bc0a45a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.082843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9bcc3-3a7d-42c0-9720-f8a7bc0a45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.083353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9bcc3-3a7d-42c0-9720-f8a7bc0a45a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.084175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9bcc3-3a7d-42c0-9720-f8a7bc0a45a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.086079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9bcc3-3a7d-42c0-9720-f8a7bc0a45a3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.098048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 947/1890] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:01.102480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.117920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af2150-9ab1-4cf0-bce6-3f42e7dce105 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.132915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.133954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.134286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.135274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] PATH_INFO: `/v3/projects/9b584002914c4433b60f0885e2ac0183/users/c358e1e96d79416699151841bc39f201/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.160679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b584002914c4433b60f0885e2ac0183, user_id=c358e1e96d79416699151841bc39f201, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.166137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.195309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.195674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.195887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.203028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 944/1891] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:01 2022] PUT /identity/v3/projects/9b584002914c4433b60f0885e2ac0183/users/c358e1e96d79416699151841bc39f201/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:01.253973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] MFA Rules not processed for user `c358e1e96d79416699151841bc39f201`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:01.256508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:01.406782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:01.468803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 948/1892] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:01.473222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.606882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213ddf-2a11-480f-9df5-5a81ed18de63 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.613479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.614263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.614612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.614908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.615803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.617881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.669903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 945/1893] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:01 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:01.674888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.688083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb46f-9c7e-41cd-86c1-a5d73ed643e7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.805103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.807412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.807942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.808451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.809757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.813197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.854522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 949/1894] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:01 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:01.858820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.870271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d13a8-6e0d-45e5-8e4f-46ee8b29a447 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.875888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.876722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.877162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.877468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.878380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.880168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.893066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 946/1895] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:01.897693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.909358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69a9e2-17e9-41ae-8f60-4c7753a51e7b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.914225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:01.915249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:01.915605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:01.915952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] PATH_INFO: `/v3/projects/bdaed8898aee469bb9b440501208c16d/users/9442d4341948453cbe72972cf0496d6e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:01.934466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdaed8898aee469bb9b440501208c16d, user_id=9442d4341948453cbe72972cf0496d6e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:01.937254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:01.952780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 950/1896] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:01 2022] PUT /identity/v3/projects/bdaed8898aee469bb9b440501208c16d/users/9442d4341948453cbe72972cf0496d6e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:01.957039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:01.969117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9366-6c16-4e9f-8bfc-2d8ace1308e3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:01.992164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:02.047581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fc3c0-87d1-4eba-96fe-a4d4db8cd79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:02.048294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fc3c0-87d1-4eba-96fe-a4d4db8cd79c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:02.048582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fc3c0-87d1-4eba-96fe-a4d4db8cd79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:02.048863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fc3c0-87d1-4eba-96fe-a4d4db8cd79c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:02.049609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fc3c0-87d1-4eba-96fe-a4d4db8cd79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:02.051308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fc3c0-87d1-4eba-96fe-a4d4db8cd79c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:02.066617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 947/1897] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:02.070997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:02.083171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1d0a9-e1ad-4dfe-978c-cb9375cf5495 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:02.088538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:02.089390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:02.089682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:02.090632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] PATH_INFO: `/v3/projects/bdaed8898aee469bb9b440501208c16d/users/9442d4341948453cbe72972cf0496d6e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:02.093086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdaed8898aee469bb9b440501208c16d, user_id=9442d4341948453cbe72972cf0496d6e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:02.096014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:02.110519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 951/1898] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:02 2022] PUT /identity/v3/projects/bdaed8898aee469bb9b440501208c16d/users/9442d4341948453cbe72972cf0496d6e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:02.122724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:02.123217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:02.124175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:02.165186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] MFA Rules not processed for user `9442d4341948453cbe72972cf0496d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:02.167157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:02.249958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 948/1899] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:02.261871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:02.326412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648752df-1afc-4b44-9e32-bb0ea7896172 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:02.331582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:02.332279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:02.332642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:02.332899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:02.345754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:02.348494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:02.383425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 952/1900] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:02.622167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:02.625709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:02.644766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42818e37-3ea7-4fd1-858e-7a355e20aad7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:02.650921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957613-3228-48df-b38a-9238a1916862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:02.651811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957613-3228-48df-b38a-9238a1916862 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:02.652271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957613-3228-48df-b38a-9238a1916862 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:02.652686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957613-3228-48df-b38a-9238a1916862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:02.755873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957613-3228-48df-b38a-9238a1916862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:02.757640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957613-3228-48df-b38a-9238a1916862 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:02.770919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 949/1901] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:03.609187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:03.666583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:03.697768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81132d15-5753-48c2-a97d-b8bc2224650c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:03.703513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:03.704403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:03.704690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:03.704967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] PATH_INFO: `/v3/users/c358e1e96d79416699151841bc39f201` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:03.706378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c358e1e96d79416699151841bc39f201)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:03.710233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:03.767831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c358e1e96d79416699151841bc39f201'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:03.768537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c358e1e96d79416699151841bc39f201'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:03.783286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c358e1e96d79416699151841bc39f201'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:03.784169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c358e1e96d79416699151841bc39f201'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:03.804559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c358e1e96d79416699151841bc39f201'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:03.828971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 953/1902] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:03 2022] DELETE /identity/v3/users/c358e1e96d79416699151841bc39f201 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:03.833674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:03.834221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:03.834221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:03.854519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:03.856080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:03.909446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:03.934659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 950/1903] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:03.960691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:03.962271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:04.050317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca61687-1613-479b-8ed7-3d60edbba1ed admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:04.055041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:04.055274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:04.055677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:04.055924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:04.069388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:04.073316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:04.092920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 954/1904] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:04.526761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:04.528239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:04.544837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6504797-3fe1-4e30-9898-0a94a9e810e5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:04.563805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:04.564689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:04.564963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:04.565239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] PATH_INFO: `/v3/projects/9b584002914c4433b60f0885e2ac0183` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:04.566892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b584002914c4433b60f0885e2ac0183)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:04.570803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:04.649447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b584002914c4433b60f0885e2ac0183', 'request_id': 'req-51ad036d-11a1-4b3b-93a5-657950d57e97'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.658251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b584002914c4433b60f0885e2ac0183', 'request_id': 'req-51ad036d-11a1-4b3b-93a5-657950d57e97'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.665428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b584002914c4433b60f0885e2ac0183', 'request_id': 'req-51ad036d-11a1-4b3b-93a5-657950d57e97'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.681369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] The token cache is being invalidate because project 9b584002914c4433b60f0885e2ac0183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:04.681666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.682619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.684363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 951/1905] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:04 2022] DELETE /identity/v3/projects/9b584002914c4433b60f0885e2ac0183 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:04.688702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:04.699758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05720426-2aca-4d81-9a9a-60ed20d0cec9 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:04.770803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:04.778262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:04.779140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:04.779618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:04.780279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] PATH_INFO: `/v3/users/9442d4341948453cbe72972cf0496d6e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:04.782005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9442d4341948453cbe72972cf0496d6e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:04.784017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:04.841770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9442d4341948453cbe72972cf0496d6e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.842654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9442d4341948453cbe72972cf0496d6e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.851854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9442d4341948453cbe72972cf0496d6e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.855015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9442d4341948453cbe72972cf0496d6e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.866980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ebe510ec-f12a-46b2-b8f0-5f6e0eb1f96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9442d4341948453cbe72972cf0496d6e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:04.893706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 955/1906] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:04 2022] DELETE /identity/v3/users/9442d4341948453cbe72972cf0496d6e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:05.444982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:05.446495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:05.461484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad036d-11a1-4b3b-93a5-657950d57e97 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:05.549186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:05.550507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:05.551271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:05.551571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] PATH_INFO: `/v3/projects/bdaed8898aee469bb9b440501208c16d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:05.553169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdaed8898aee469bb9b440501208c16d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:05.555585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:05.646533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdaed8898aee469bb9b440501208c16d', 'request_id': 'req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:05.654549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdaed8898aee469bb9b440501208c16d', 'request_id': 'req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:05.663462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdaed8898aee469bb9b440501208c16d', 'request_id': 'req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:05.674943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:05.688462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] The token cache is being invalidate because project bdaed8898aee469bb9b440501208c16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:05.690266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:05.691062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bc8adb05-9ec2-40b3-b407-e8b444be8fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:05.693587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 952/1907] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:05 2022] DELETE /identity/v3/projects/bdaed8898aee469bb9b440501208c16d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:05.698885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:05.699392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:05.699523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:05.723576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:05.725751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:05.857224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 956/1908] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:05.866613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:05.866901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:05.867233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:05.892347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:05.894189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:05.904187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 953/1909] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:05.909426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:05.920372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af7c7-b3f7-4ed3-953e-24335a1f05f2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:05.926794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:05.927754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:05.928192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:05.928723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:05.930177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:05.930177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:05.931788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:05.966514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 957/1910] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:05.971495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:05.989441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296fd87-6947-4f9f-a812-24a3edcfab4d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:05.996509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:05.997199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:05.997495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:05.997805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:05.999135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:06.001234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:06.072599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 954/1911] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:05 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:06.074488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:06.089438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bef140-d998-483e-b8d2-857521dec9c5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:06.169581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:06.171609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:06.171788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:06.172202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:06.173153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:06.179566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:06.196020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:06.217973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 958/1912] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:06 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:06.221841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:06.237842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606675b-503f-47d9-9884-97bbcd30e9d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:06.245932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:06.246884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:06.247339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:06.247731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:06.249448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:06.252195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:06.265097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 955/1913] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:06.268840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:06.281540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac177bc-af45-4f34-b9b6-43957c4f747c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:06.286601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc0497-5063-4835-a586-683c61858103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:06.287397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0497-5063-4835-a586-683c61858103 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:06.287756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0497-5063-4835-a586-683c61858103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:06.288114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0497-5063-4835-a586-683c61858103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:06.288938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0497-5063-4835-a586-683c61858103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:06.290627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0497-5063-4835-a586-683c61858103 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:06.304525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 959/1914] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:06.309193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:06.320048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fce65-aaba-45a3-bb37-c0ebd7622d94 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:06.327071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:06.328517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:06.329077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:06.329570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] PATH_INFO: `/v3/projects/9d6d066dfcef445fad603f1aa276a3f7/users/418c30d6960045cea7c810daa4c4c175/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:06.347301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6d066dfcef445fad603f1aa276a3f7, user_id=418c30d6960045cea7c810daa4c4c175, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:06.350018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:06.366596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 956/1915] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:06 2022] PUT /identity/v3/projects/9d6d066dfcef445fad603f1aa276a3f7/users/418c30d6960045cea7c810daa4c4c175/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:06.378741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:06.378950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:06.379283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:06.414761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] MFA Rules not processed for user `418c30d6960045cea7c810daa4c4c175`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:06.416090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:06.503123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 960/1916] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:06.515848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:06.517890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:06.586743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7b4a5-b3d4-4515-9691-bcd879e9b651 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:06.593087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea78c-6b8b-48cc-80bb-0e11d90b33ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:06.594556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea78c-6b8b-48cc-80bb-0e11d90b33ac service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:06.594857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea78c-6b8b-48cc-80bb-0e11d90b33ac service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:06.595172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea78c-6b8b-48cc-80bb-0e11d90b33ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:06.604976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea78c-6b8b-48cc-80bb-0e11d90b33ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:06.606464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea78c-6b8b-48cc-80bb-0e11d90b33ac service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:06.618320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 957/1917] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:16.498309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:16.612776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:21.081332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:21.083174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:21.157132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ac39a-039c-4202-a9e7-3ebd73345556 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:21.161914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:21.162776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:21.163062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:21.163376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] PATH_INFO: `/v3/users/87ca47e7461f485f87537b2a7db0deda` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:21.164646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ca47e7461f485f87537b2a7db0deda)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:21.166799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:21.225927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ca47e7461f485f87537b2a7db0deda'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:21.226717 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ca47e7461f485f87537b2a7db0deda'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:21.237748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ca47e7461f485f87537b2a7db0deda'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:21.238536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ca47e7461f485f87537b2a7db0deda'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:21.246933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ca47e7461f485f87537b2a7db0deda'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:21.268673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 961/1918] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:21 2022] DELETE /identity/v3/users/87ca47e7461f485f87537b2a7db0deda => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:21.274655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:21.275258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:21.276663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:21.299800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:21.301111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:21.378770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 958/1919] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:21.389681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:21.391782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:21.462199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48896b1-bd1d-42f7-97d5-29feb0f5564a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:21.466150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:21.466867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:21.467195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:21.467993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:21.478513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:21.479994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:21.492519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 962/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:21.852688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:21.854986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:21.902525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b0c46-167a-445b-8f5e-1bb9216a06e6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:21.917351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:21.918516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:21.919123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:21.919645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] PATH_INFO: `/v3/projects/68385c04fe4c4264bdf1aac7a2c7efd0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:21.926473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] RBAC: Authorizing `identity:delete_project(project_id=68385c04fe4c4264bdf1aac7a2c7efd0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:21.929006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:22.031556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68385c04fe4c4264bdf1aac7a2c7efd0', 'request_id': 'req-681b22c5-7c35-4c41-9e71-596f9017eefc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.040156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68385c04fe4c4264bdf1aac7a2c7efd0', 'request_id': 'req-681b22c5-7c35-4c41-9e71-596f9017eefc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.049779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68385c04fe4c4264bdf1aac7a2c7efd0', 'request_id': 'req-681b22c5-7c35-4c41-9e71-596f9017eefc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.073119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] The token cache is being invalidate because project 68385c04fe4c4264bdf1aac7a2c7efd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:22.073505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.075246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.077896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 959/1921] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:21 2022] DELETE /identity/v3/projects/68385c04fe4c4264bdf1aac7a2c7efd0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:22.082280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:22.093422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c71f-8e95-42fc-b6f9-980b50604ac7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:22.122813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:22.185171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:22.186077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:22.187018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:22.187570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] PATH_INFO: `/v3/users/e7ac4244c98149729ddc85fce025ef49` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:22.190468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ac4244c98149729ddc85fce025ef49)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:22.193246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:22.272122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ac4244c98149729ddc85fce025ef49'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.273845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ac4244c98149729ddc85fce025ef49'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.286730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ac4244c98149729ddc85fce025ef49'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.287980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ac4244c98149729ddc85fce025ef49'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.298821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-030dbc6e-9e07-40d0-a3b0-4a34cc8dc31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ac4244c98149729ddc85fce025ef49'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.339051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 963/1922] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:22 2022] DELETE /identity/v3/users/e7ac4244c98149729ddc85fce025ef49 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:22.649421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:22.651021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:22.671833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b22c5-7c35-4c41-9e71-596f9017eefc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:22.733426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:22.734331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:22.734634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:22.734925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] PATH_INFO: `/v3/projects/0ae409e148254d12bc05b8fe37ed84c9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:22.736303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae409e148254d12bc05b8fe37ed84c9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:22.738357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:22.775123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:22.796585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae409e148254d12bc05b8fe37ed84c9', 'request_id': 'req-c75d1f47-27ed-4a64-9815-5db4893a2f23'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.803253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae409e148254d12bc05b8fe37ed84c9', 'request_id': 'req-c75d1f47-27ed-4a64-9815-5db4893a2f23'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.809614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae409e148254d12bc05b8fe37ed84c9', 'request_id': 'req-c75d1f47-27ed-4a64-9815-5db4893a2f23'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.823225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] The token cache is being invalidate because project 0ae409e148254d12bc05b8fe37ed84c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:22.823571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.824175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c75d1f47-27ed-4a64-9815-5db4893a2f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:22.826000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 960/1923] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:22 2022] DELETE /identity/v3/projects/0ae409e148254d12bc05b8fe37ed84c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:22.831656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:22.831955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:22.832241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:22.852158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:22.853430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:22.916711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 964/1924] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:22.925289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:22.925608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:22.925922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:22.945160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:22.946365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:22.954944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 961/1925] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:22.959624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:22.971759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013300c-2603-4a54-b945-dc424fb8192e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:22.976626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:22.977292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:22.977581 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:22.977861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:22.982761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:22.983752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:22.985653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:22.999262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 965/1926] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:23.003567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.012718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedcea5-28a9-40b8-9139-4205ec563520 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.017939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.018596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.018885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.019206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.019896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.021828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.054314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 962/1927] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:23 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:23.058628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.068780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9f3a-8763-48a0-82a0-5f82b67a3a34 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.094700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:23.132603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.133568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.133708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.133979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.134958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.136877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.174215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 966/1928] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:23 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:23.178356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.189880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd7cd0-65d9-404a-872f-812487a5c638 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.198022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.198709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.198993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.199336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.200056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.201658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.216405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 963/1929] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:23.220910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.231745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba66267-2ac5-4a78-b72b-b25e217d6506 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.237921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b739a6-44c3-42ef-ab80-70947f56e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.238734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b739a6-44c3-42ef-ab80-70947f56e663 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.239021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b739a6-44c3-42ef-ab80-70947f56e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.239333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b739a6-44c3-42ef-ab80-70947f56e663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.240061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b739a6-44c3-42ef-ab80-70947f56e663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.242454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b739a6-44c3-42ef-ab80-70947f56e663 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.259142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 967/1930] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:23.262591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.275363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948df535-f0b3-4d53-b416-b17737f824d1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.280058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.281618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.281902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.282177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] PATH_INFO: `/v3/projects/29c02cc560a44f01b5e63f41509f5965/users/d71b2c705dbd48c196fe26031118c961/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.300489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c02cc560a44f01b5e63f41509f5965, user_id=d71b2c705dbd48c196fe26031118c961, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.303734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.330283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 964/1931] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:23 2022] PUT /identity/v3/projects/29c02cc560a44f01b5e63f41509f5965/users/d71b2c705dbd48c196fe26031118c961/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:23.332143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.332432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.332710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.371953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] MFA Rules not processed for user `d71b2c705dbd48c196fe26031118c961`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:23.373157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:23.445312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 968/1932] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:23.450014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.513983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0476d-c6af-47db-b10d-7d2077574f72 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.518807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.519502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.519788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.520071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.520761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.522682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.548463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 965/1933] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:23 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:23.552524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.564713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf58d0-e7c1-4c0c-bfa1-e3ece66607d5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.624844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.625518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.625804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.626086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.626809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.628780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.648714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 969/1934] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:23 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:23.652659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.663975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28415d2-ad79-4f37-bd3b-ff8d7421f60f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.668771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.669464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.669726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.670001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.671921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.673574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.689851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 966/1935] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:23.691008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.705385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf76e4-089d-454a-84a1-a236a7a221b7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.710582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.711514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.711797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.712089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] PATH_INFO: `/v3/projects/ea33f5567e264c9fbd1d55a040ab562c/users/53409ff06e794acca444dfc451dd94bb/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.738887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea33f5567e264c9fbd1d55a040ab562c, user_id=53409ff06e794acca444dfc451dd94bb, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.742365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.757346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 970/1936] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:23 2022] PUT /identity/v3/projects/ea33f5567e264c9fbd1d55a040ab562c/users/53409ff06e794acca444dfc451dd94bb/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:23.761555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.772644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca877d06-65fd-44e7-9fab-ef5e30e4840e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.794170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:23.844401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b9430-091a-490b-a378-faed30db7f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.845435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b9430-091a-490b-a378-faed30db7f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.845748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b9430-091a-490b-a378-faed30db7f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.846126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b9430-091a-490b-a378-faed30db7f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.847030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b9430-091a-490b-a378-faed30db7f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.849290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b9430-091a-490b-a378-faed30db7f43 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.865539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 967/1937] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:23.872156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:23.878892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:23.885262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f5fac-bf0a-42c8-95bf-56208d5812f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:23.892145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:23.893121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.893388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.893679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] PATH_INFO: `/v3/projects/ea33f5567e264c9fbd1d55a040ab562c/users/53409ff06e794acca444dfc451dd94bb/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.895749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea33f5567e264c9fbd1d55a040ab562c, user_id=53409ff06e794acca444dfc451dd94bb, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:23.898662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:23.909856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 971/1938] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:23 2022] PUT /identity/v3/projects/ea33f5567e264c9fbd1d55a040ab562c/users/53409ff06e794acca444dfc451dd94bb/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:23.920062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:23.920356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:23.920706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:23.954038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] MFA Rules not processed for user `53409ff06e794acca444dfc451dd94bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:23.955213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:24.037874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 968/1939] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:24.050720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:24.052608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:24.131558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c73a3-5bcf-4fc1-bc1e-d63ca51b078e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:24.136077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348058-4bba-4b9a-9696-130061906825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:24.136757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348058-4bba-4b9a-9696-130061906825 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:24.137042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348058-4bba-4b9a-9696-130061906825 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:24.137315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348058-4bba-4b9a-9696-130061906825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:24.171422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348058-4bba-4b9a-9696-130061906825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:24.171422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348058-4bba-4b9a-9696-130061906825 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:24.185872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 972/1940] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:24.620007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:24.737881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927478-f6e0-4e2c-b1da-ef6c4432b97d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:24.743928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:24.744803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:24.745295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:24.745588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] PATH_INFO: `/v3/users/d71b2c705dbd48c196fe26031118c961` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:24.746860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71b2c705dbd48c196fe26031118c961)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:24.750317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:24.758701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:24.805948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71b2c705dbd48c196fe26031118c961'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:24.814612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71b2c705dbd48c196fe26031118c961'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:24.815410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71b2c705dbd48c196fe26031118c961'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:24.832482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71b2c705dbd48c196fe26031118c961'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:24.833694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71b2c705dbd48c196fe26031118c961'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:24.847505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 969/1941] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:24 2022] DELETE /identity/v3/users/d71b2c705dbd48c196fe26031118c961 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:24.853901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:24.854317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:24.855202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:24.895358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:24.896551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:24.958169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 973/1942] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:24.968686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:24.969416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:25.071929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3b194-038a-4878-93b2-d0a93d33e7be admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:25.075764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:25.076454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:25.076716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:25.077020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:25.086568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:25.088049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:25.097816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 970/1943] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:25.396963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:25.398816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:25.411707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954b51-91db-47aa-abd2-7791d72be002 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:25.416389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:25.417272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:25.417557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:25.417835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] PATH_INFO: `/v3/projects/29c02cc560a44f01b5e63f41509f5965` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:25.419048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c02cc560a44f01b5e63f41509f5965)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:25.421190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:25.466287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:25.485440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c02cc560a44f01b5e63f41509f5965', 'request_id': 'req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.493196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c02cc560a44f01b5e63f41509f5965', 'request_id': 'req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.501252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c02cc560a44f01b5e63f41509f5965', 'request_id': 'req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.511707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] The token cache is being invalidate because project 29c02cc560a44f01b5e63f41509f5965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:25.512063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.513034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.515330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 974/1944] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:25 2022] DELETE /identity/v3/projects/29c02cc560a44f01b5e63f41509f5965 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:25.519762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:25.532562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29a4a-23cc-4599-9319-0dd6e0a63fc5 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:25.588122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:25.602628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:25.603564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:25.604096 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:25.604387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] PATH_INFO: `/v3/users/53409ff06e794acca444dfc451dd94bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:25.605607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53409ff06e794acca444dfc451dd94bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:25.607787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:25.659408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53409ff06e794acca444dfc451dd94bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.668893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53409ff06e794acca444dfc451dd94bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.669732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53409ff06e794acca444dfc451dd94bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.685185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53409ff06e794acca444dfc451dd94bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.686037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a73a0f80-b204-4af4-9593-9a8c5f714e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53409ff06e794acca444dfc451dd94bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:25.698878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 971/1945] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:25 2022] DELETE /identity/v3/users/53409ff06e794acca444dfc451dd94bb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:25.988607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:25.990143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.004458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a5da-e2d9-4d8f-ab39-5f2e723eb884 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.069607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.070485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.070768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.071046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] PATH_INFO: `/v3/projects/ea33f5567e264c9fbd1d55a040ab562c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.072280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea33f5567e264c9fbd1d55a040ab562c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.074216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.133630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea33f5567e264c9fbd1d55a040ab562c', 'request_id': 'req-623a4821-e751-4e43-8e25-59895eeb0c78'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.142429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea33f5567e264c9fbd1d55a040ab562c', 'request_id': 'req-623a4821-e751-4e43-8e25-59895eeb0c78'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.150371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea33f5567e264c9fbd1d55a040ab562c', 'request_id': 'req-623a4821-e751-4e43-8e25-59895eeb0c78'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.162206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] The token cache is being invalidate because project ea33f5567e264c9fbd1d55a040ab562c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:26.162499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.163203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-623a4821-e751-4e43-8e25-59895eeb0c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.164865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 975/1946] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:25 2022] DELETE /identity/v3/projects/ea33f5567e264c9fbd1d55a040ab562c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:26.169973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.170541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.170884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.218001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:26.219878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.282025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 972/1947] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:26.290091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.290385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.290721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.309959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:26.311615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.324656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 976/1948] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:26.330440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.340299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee88aa-2ba2-4ab6-936c-c74df3f31e6d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.347127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.347874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.348235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.348589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.349635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:26.349895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.351801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.366614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 973/1949] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:26.370738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.388112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65370-e3f9-4c6c-8307-b98ffb5c3655 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.396284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.397092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.397599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.397673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.398761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.400810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.435429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 977/1950] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:26 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:26.436863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.450883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190041-8b23-4848-a557-1f4352835b2d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.507990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:26.547694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.547832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.548505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.548795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.549294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.549779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.550010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.552586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.566279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769aba7-016c-442a-a615-84d519613f8a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.572075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.572811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.573099 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.573393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] PATH_INFO: `/v3/users/3b7a1284bc044e51923c72a9f8f41d95` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.574628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7a1284bc044e51923c72a9f8f41d95)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.576546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.588063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 974/1951] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:26 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:26.589751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.601090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103c7ec-1617-4921-bc17-b54db40ffedd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.606221 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:26.613059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.613739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.614106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.614424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.615395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.616945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.628843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 975/1952] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:26.632878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.645031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7a1284bc044e51923c72a9f8f41d95'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.645255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095896e-2700-48c2-b5e4-1ecfb5f931b9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.645725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7a1284bc044e51923c72a9f8f41d95'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.651700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.652246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.652537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.652820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.653656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.653810 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7a1284bc044e51923c72a9f8f41d95'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.654655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7a1284bc044e51923c72a9f8f41d95'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.656071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.665978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dae717f0-4b53-4d19-9a96-c44cb19b574d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7a1284bc044e51923c72a9f8f41d95'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:26.667110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 976/1953] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:26.671887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.673719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.687240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dfd2b-e6db-492b-a3ee-b637568b7350 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:26.692528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:26.692888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 978/1954] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:26 2022] DELETE /identity/v3/users/3b7a1284bc044e51923c72a9f8f41d95 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:26.693479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.693810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.694090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] PATH_INFO: `/v3/projects/4564a0e6a2994d02bb6c880f1464ead9/users/058fa9aceb9948a68b2db3cf20929ccf/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.726397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4564a0e6a2994d02bb6c880f1464ead9, user_id=058fa9aceb9948a68b2db3cf20929ccf, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:26.729203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:26.755035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 977/1955] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:26 2022] PUT /identity/v3/projects/4564a0e6a2994d02bb6c880f1464ead9/users/058fa9aceb9948a68b2db3cf20929ccf/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:26.767296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:26.767819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:26.768363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:26.842384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] MFA Rules not processed for user `058fa9aceb9948a68b2db3cf20929ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:26.842384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.926622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:26.929227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:26.935595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 979/1956] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:26.937650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.052312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b4893-3013-45ea-b41a-9a539f581626 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.055255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bc54a-1756-4f2a-a3a5-3dff385e9638 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.057083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.057757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.058049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.058355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.059062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.060576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.061009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.062067 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.062485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.062775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] PATH_INFO: `/v3/projects/39490fef872043d1bfef791dd0bbb5a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.064065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39490fef872043d1bfef791dd0bbb5a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.066028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.091264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 980/1957] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:26 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:27.095388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.109488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:27.116565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39490fef872043d1bfef791dd0bbb5a5', 'request_id': 'req-f2694d87-c1da-4d6c-9e90-4f9076179ff3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:27.125098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39490fef872043d1bfef791dd0bbb5a5', 'request_id': 'req-f2694d87-c1da-4d6c-9e90-4f9076179ff3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:27.131310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39490fef872043d1bfef791dd0bbb5a5', 'request_id': 'req-f2694d87-c1da-4d6c-9e90-4f9076179ff3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:27.146934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] The token cache is being invalidate because project 39490fef872043d1bfef791dd0bbb5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:27.147270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:27.147936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f2694d87-c1da-4d6c-9e90-4f9076179ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:27.149815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 978/1958] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:26 2022] DELETE /identity/v3/projects/39490fef872043d1bfef791dd0bbb5a5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:27.156530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.156824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.157099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.170568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec029-071a-4094-9f11-3e4e41a446a1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.183457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:27.184897 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.195663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:27.243681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab56a3-98d7-4fc9-b85b-0802c55bd867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.244369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab56a3-98d7-4fc9-b85b-0802c55bd867 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.244654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab56a3-98d7-4fc9-b85b-0802c55bd867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.244933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab56a3-98d7-4fc9-b85b-0802c55bd867 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.245688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab56a3-98d7-4fc9-b85b-0802c55bd867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.247712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab56a3-98d7-4fc9-b85b-0802c55bd867 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.265324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 979/1959] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:27.269386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 981/1960] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:27.273548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.273934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.274251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.274662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.276015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.293351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7114-3669-4cf2-a96f-f5e6b69d24f7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.297567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:27.298956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.300148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.301013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.301297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.301573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.302307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.304028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.307642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 982/1961] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:27.312077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.317849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 980/1962] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:27.321148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e8a4c-fe7b-4381-873e-95e042d23b46 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.321612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.325836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.326489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.327361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.327626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.328496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:27.328807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.330427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.331942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24dc8-b1a3-45a5-91ff-64ee1b770c1e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.336587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.337491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.337777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.338057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] PATH_INFO: `/v3/projects/ea451e16ad8444518f7faa35421c7c01/users/7c25406177c247d89003fe2cc72554a0/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.346241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 983/1963] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:10:27.347602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.355054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea451e16ad8444518f7faa35421c7c01, user_id=7c25406177c247d89003fe2cc72554a0, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.358166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.358819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea11b08-a2c2-418d-9a30-1da9c904bb4f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.364111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.364899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.365186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.365477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.366228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.368279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.371188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 981/1964] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:27 2022] PUT /identity/v3/projects/ea451e16ad8444518f7faa35421c7c01/users/7c25406177c247d89003fe2cc72554a0/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:27.375276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.398286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 984/1965] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:27.402451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.458484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82e7a-8128-4f45-8e0a-d338b0771c7e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.475977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906b45-8978-495c-b45f-59cd552b6d71 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.481747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.483055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.483462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.483784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.484493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.486598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.502700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:27.510924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 985/1966] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:27.515708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.526483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.526691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff4804-15d2-4c0b-b8b9-06fea8101422 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.527212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.527504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.527781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.528545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.530617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.532352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.533053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.533345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.533629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.534366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.536003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.540907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 982/1967] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:27.544945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.546995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 986/1968] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:27.551015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.560616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d21e-a230-47e7-a412-e28d8a9336f2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.563949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974a14-bd75-4477-a8d8-4575698aefbe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.566466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.567400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.567693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.567980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] PATH_INFO: `/v3/projects/ea451e16ad8444518f7faa35421c7c01/users/7c25406177c247d89003fe2cc72554a0/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.568695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e610b31-1f19-4b6a-b18e-0beb6512458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.569360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e610b31-1f19-4b6a-b18e-0beb6512458f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.569646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e610b31-1f19-4b6a-b18e-0beb6512458f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.569926 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e610b31-1f19-4b6a-b18e-0beb6512458f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.570031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea451e16ad8444518f7faa35421c7c01, user_id=7c25406177c247d89003fe2cc72554a0, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.570653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e610b31-1f19-4b6a-b18e-0beb6512458f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.572292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e610b31-1f19-4b6a-b18e-0beb6512458f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.572905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.585728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 983/1969] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:27 2022] PUT /identity/v3/projects/ea451e16ad8444518f7faa35421c7c01/users/7c25406177c247d89003fe2cc72554a0/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:27.586844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 987/1970] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:27.590655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.596156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.596454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.596736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.609760 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:27.626063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] MFA Rules not processed for user `7c25406177c247d89003fe2cc72554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:27.627407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.668498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a5261-ee12-44f2-858c-9ab89a886ae8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.673398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c44b9d-8976-47eb-95ac-1839c7ae8660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.674336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c44b9d-8976-47eb-95ac-1839c7ae8660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.674695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c44b9d-8976-47eb-95ac-1839c7ae8660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.674886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c44b9d-8976-47eb-95ac-1839c7ae8660 admin admin] PATH_INFO: `/v3/projects/0481ff1d91a64d39b39d3dad413df8e5/users/b6bae679777d474d838f8f5998a16f56/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.690673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c44b9d-8976-47eb-95ac-1839c7ae8660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0481ff1d91a64d39b39d3dad413df8e5, user_id=b6bae679777d474d838f8f5998a16f56, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.693454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c44b9d-8976-47eb-95ac-1839c7ae8660 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.707912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 988/1971] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:27.711592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 984/1972] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:27 2022] PUT /identity/v3/projects/0481ff1d91a64d39b39d3dad413df8e5/users/b6bae679777d474d838f8f5998a16f56/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:27.719252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.720138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.720437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.720736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.720888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.747895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] MFA Rules not processed for user `b6bae679777d474d838f8f5998a16f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:27.750108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.784470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674c36f-181f-46d4-b24d-32181ef2aa4b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.823746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 985/1973] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:27.836195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:27.837625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:27.837782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.838454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.838741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.839021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.874939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:27.907597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.909029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.917355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da79113-6e34-4abf-898e-79db37d38121 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:27.918985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 989/1974] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:27.923899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60683d6-bb54-48f5-be15-6711a4997ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:27.924587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60683d6-bb54-48f5-be15-6711a4997ab8 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:27.924905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60683d6-bb54-48f5-be15-6711a4997ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:27.925191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60683d6-bb54-48f5-be15-6711a4997ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:27.934716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60683d6-bb54-48f5-be15-6711a4997ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:27.936814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60683d6-bb54-48f5-be15-6711a4997ab8 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:27.947769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 986/1975] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:28.095136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:28.177568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d58ad-7f39-4e17-9fed-da0565a76562 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:28.183463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:28.184569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:28.184999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:28.185346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] PATH_INFO: `/v3/users/058fa9aceb9948a68b2db3cf20929ccf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:28.187468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=058fa9aceb9948a68b2db3cf20929ccf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:28.189634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:28.256997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058fa9aceb9948a68b2db3cf20929ccf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.257673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058fa9aceb9948a68b2db3cf20929ccf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.266077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058fa9aceb9948a68b2db3cf20929ccf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.266806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058fa9aceb9948a68b2db3cf20929ccf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.276525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058fa9aceb9948a68b2db3cf20929ccf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.313643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 990/1976] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:28 2022] DELETE /identity/v3/users/058fa9aceb9948a68b2db3cf20929ccf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:28.321051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623abe-9252-4020-af16-7eae73902987 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:28.322623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623abe-9252-4020-af16-7eae73902987 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:28.323488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623abe-9252-4020-af16-7eae73902987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:28.352684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-14623abe-9252-4020-af16-7eae73902987 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:28.354867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14623abe-9252-4020-af16-7eae73902987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:28.365231 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:28.442603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 987/1977] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:28.449434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:28.451065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:28.509895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:28.516371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8af4a-e6ae-46ce-99a6-089836031ccb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:28.520838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:28.521489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:28.521778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:28.522059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:28.532435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:28.533887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:28.543513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 991/1978] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:28.822775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14623abe-9252-4020-af16-7eae73902987 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:28.824624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14623abe-9252-4020-af16-7eae73902987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:28.838482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14623abe-9252-4020-af16-7eae73902987 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:28.844054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:28.844929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:28.845215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:28.845662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] PATH_INFO: `/v3/projects/4564a0e6a2994d02bb6c880f1464ead9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:28.847008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4564a0e6a2994d02bb6c880f1464ead9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:28.848975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:28.899956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4564a0e6a2994d02bb6c880f1464ead9', 'request_id': 'req-e9e21f86-198e-4067-a630-f1f116c2062a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.907605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4564a0e6a2994d02bb6c880f1464ead9', 'request_id': 'req-e9e21f86-198e-4067-a630-f1f116c2062a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.913429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4564a0e6a2994d02bb6c880f1464ead9', 'request_id': 'req-e9e21f86-198e-4067-a630-f1f116c2062a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.926171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] The token cache is being invalidate because project 4564a0e6a2994d02bb6c880f1464ead9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:28.926461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.927102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:28.928674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 988/1979] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:28 2022] DELETE /identity/v3/projects/4564a0e6a2994d02bb6c880f1464ead9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:28.932634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:28.943448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47516f2-8d32-4250-a18b-8acbe61bccf1 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.002553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.003477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.003765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.004046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] PATH_INFO: `/v3/users/7c25406177c247d89003fe2cc72554a0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.005220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c25406177c247d89003fe2cc72554a0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.007174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.061700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c25406177c247d89003fe2cc72554a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.062445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c25406177c247d89003fe2cc72554a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.070619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c25406177c247d89003fe2cc72554a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.070619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c25406177c247d89003fe2cc72554a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.078553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-72001f76-7a20-411b-b6fe-c26c14b14c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c25406177c247d89003fe2cc72554a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.096427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 992/1980] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:28 2022] DELETE /identity/v3/users/7c25406177c247d89003fe2cc72554a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:29.382430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.383970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:29.404279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21f86-198e-4067-a630-f1f116c2062a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.474725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.475368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.475655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.475930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] PATH_INFO: `/v3/projects/ea451e16ad8444518f7faa35421c7c01` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.477108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea451e16ad8444518f7faa35421c7c01)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.479060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.524456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:29.536924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea451e16ad8444518f7faa35421c7c01', 'request_id': 'req-bbb0e1f6-53de-49a3-838b-98e9e6377675'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.545588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea451e16ad8444518f7faa35421c7c01', 'request_id': 'req-bbb0e1f6-53de-49a3-838b-98e9e6377675'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.553177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea451e16ad8444518f7faa35421c7c01', 'request_id': 'req-bbb0e1f6-53de-49a3-838b-98e9e6377675'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.567478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] The token cache is being invalidate because project ea451e16ad8444518f7faa35421c7c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:29.567766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.568389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbb0e1f6-53de-49a3-838b-98e9e6377675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:29.570197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 989/1981] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:29 2022] DELETE /identity/v3/projects/ea451e16ad8444518f7faa35421c7c01 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:29.575301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.575792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.575993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.601035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:29.602728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:29.675267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 993/1982] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:29.681105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.681731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.682296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.704939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:29.706549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:29.719172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 990/1983] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:29.722090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.732231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149ccf-dc34-480d-a517-678ca5c1cf18 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.739174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.739957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.740178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.740471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.741232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:29.741563 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.743323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.746632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:29.758623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 994/1984] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:10:29.762767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.772529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19814d5a-d500-432c-ab61-b3e136d5de21 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.777555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.778212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.778500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.778781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.779530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.782368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.809469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 991/1985] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:29 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:29.813949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.824124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6326082-d833-4a45-8fec-6cdea0002ee7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.883718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.884399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.884686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.884964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.885676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.887650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.913147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 995/1986] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:29.914314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.925844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e54e8-6469-4f82-9d88-d81855a67577 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.931342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.932019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.932311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.932611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.933400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.935145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.946065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 992/1987] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:29.950359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.962029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239595ea-a7b2-4c3b-aecb-d4eeb67e210c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:29.967978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a180-a54e-48ba-8ed6-a07b50f43aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:29.969108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a180-a54e-48ba-8ed6-a07b50f43aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:29.969438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a180-a54e-48ba-8ed6-a07b50f43aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:29.969739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a180-a54e-48ba-8ed6-a07b50f43aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:29.970569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a180-a54e-48ba-8ed6-a07b50f43aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:29.972202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a180-a54e-48ba-8ed6-a07b50f43aa9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:29.982534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 996/1988] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:29.987418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:29.998229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d02861-5362-4d03-bee2-78ceaff7305d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.003365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.004257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.004545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.004830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] PATH_INFO: `/v3/projects/3b486b69233d46dfb420298418a597e5/users/80c7d089a92642fcb76ed153012a203a/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.021240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b486b69233d46dfb420298418a597e5, user_id=80c7d089a92642fcb76ed153012a203a, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.024342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.040247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 993/1989] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:29 2022] PUT /identity/v3/projects/3b486b69233d46dfb420298418a597e5/users/80c7d089a92642fcb76ed153012a203a/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:30.052737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.053030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.053306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.083975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] MFA Rules not processed for user `80c7d089a92642fcb76ed153012a203a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:30.085208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:30.167785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 997/1990] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:30.171910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.234747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaa443-6f9a-4a0c-ae46-4234cb7c02b6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.239489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.240162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.240513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.240805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.241526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.243485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.270075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 994/1991] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:30 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:30.274649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.286116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342b4f9-eb4f-4cef-82f6-af2ddad872c6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.344284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.344962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.345245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.345530 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.346220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.348166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.356726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:30.368602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 998/1992] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:30 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:30.372732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.384527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ad993-474d-4d8a-9b96-a6fbc9b3ca81 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.390070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.390755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.391046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.391365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.392108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.393727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.406242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 995/1993] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:30.409829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.420108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2899f-5eb0-4152-bfb9-b28eb3605c7e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.425295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.426195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.426481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.426763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] PATH_INFO: `/v3/projects/d962380df4e242ff8fbdc75f3fb76906/users/7728e1bbd46a413399715f8943cadaef/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.444167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d962380df4e242ff8fbdc75f3fb76906, user_id=7728e1bbd46a413399715f8943cadaef, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.446968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.461583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 999/1994] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:30 2022] PUT /identity/v3/projects/d962380df4e242ff8fbdc75f3fb76906/users/7728e1bbd46a413399715f8943cadaef/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:30.465833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.478131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a992-5354-46a7-892c-99e59cea55b9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.511151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:30.540898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb14e6-403e-4093-9a80-d22b97be22e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.541762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb14e6-403e-4093-9a80-d22b97be22e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.542159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb14e6-403e-4093-9a80-d22b97be22e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.542553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb14e6-403e-4093-9a80-d22b97be22e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.543485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb14e6-403e-4093-9a80-d22b97be22e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.545089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb14e6-403e-4093-9a80-d22b97be22e6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.559070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 996/1995] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:30.560490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.573869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6db818-1fd8-43a6-85ed-1a9d7002decd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.579901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.580981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.581271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.581552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] PATH_INFO: `/v3/projects/d962380df4e242ff8fbdc75f3fb76906/users/7728e1bbd46a413399715f8943cadaef/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.583756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d962380df4e242ff8fbdc75f3fb76906, user_id=7728e1bbd46a413399715f8943cadaef, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.586404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.599469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1000/1996] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:30 2022] PUT /identity/v3/projects/d962380df4e242ff8fbdc75f3fb76906/users/7728e1bbd46a413399715f8943cadaef/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:30.610961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.611293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.611684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.638829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] MFA Rules not processed for user `7728e1bbd46a413399715f8943cadaef`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:30.640552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:30.716886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 997/1997] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:30.728918 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.730663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:30.789405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:30.790693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:30.794555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf1ea-f2e2-4e2d-8e8a-99c48f433c1e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.799864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be2fc-2c46-4294-bd64-ab6b0a70c6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.800522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be2fc-2c46-4294-bd64-ab6b0a70c6fb service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.800963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be2fc-2c46-4294-bd64-ab6b0a70c6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.801355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be2fc-2c46-4294-bd64-ab6b0a70c6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.814281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716be2fc-2c46-4294-bd64-ab6b0a70c6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.815863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716be2fc-2c46-4294-bd64-ab6b0a70c6fb service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.826536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1001/1998] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:30.864544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168dd0-6681-41cd-a781-88a7be723617 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:30.869257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:30.870147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.870436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.870723 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] PATH_INFO: `/v3/users/b6bae679777d474d838f8f5998a16f56` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.871970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bae679777d474d838f8f5998a16f56)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:30.874058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:30.927615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bae679777d474d838f8f5998a16f56'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:30.935454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bae679777d474d838f8f5998a16f56'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:30.936191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bae679777d474d838f8f5998a16f56'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:30.938244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:30.961660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bae679777d474d838f8f5998a16f56'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:30.961660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bae679777d474d838f8f5998a16f56'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:30.972092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 998/1999] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:30 2022] DELETE /identity/v3/users/b6bae679777d474d838f8f5998a16f56 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:30.978887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:30.978887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:30.978887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:30.997325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:30.998593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.072969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1002/2000] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:31.083579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.087299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.165640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53022-e98c-45ac-acd5-4515edad8281 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.171153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.172019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.174551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.174867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.187073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.188763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.199056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 999/2001] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:31.463161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.465175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.478922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4e7b1-55c3-4f5e-81a8-089fdcd9650b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.485626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.486499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.486784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.487065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] PATH_INFO: `/v3/users/80c7d089a92642fcb76ed153012a203a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.488395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c7d089a92642fcb76ed153012a203a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.490263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.499850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.501443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.523275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5d29f-8489-438e-afa7-fb69c384cae6 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.528401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.529597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.531173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.531601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] PATH_INFO: `/v3/projects/0481ff1d91a64d39b39d3dad413df8e5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.533045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0481ff1d91a64d39b39d3dad413df8e5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.535349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.550201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c7d089a92642fcb76ed153012a203a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.550772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c7d089a92642fcb76ed153012a203a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.557348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:31.560040 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c7d089a92642fcb76ed153012a203a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.561138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c7d089a92642fcb76ed153012a203a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.572087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4f4b72de-269a-4c1a-a04b-3efcc93d0280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c7d089a92642fcb76ed153012a203a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.590472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0481ff1d91a64d39b39d3dad413df8e5', 'request_id': 'req-051cba03-65f6-4fe7-a187-81ec5b63637e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.594858 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1003/2002] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:31 2022] DELETE /identity/v3/users/80c7d089a92642fcb76ed153012a203a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:31.598466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0481ff1d91a64d39b39d3dad413df8e5', 'request_id': 'req-051cba03-65f6-4fe7-a187-81ec5b63637e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.599250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.599551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.599875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.604637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0481ff1d91a64d39b39d3dad413df8e5', 'request_id': 'req-051cba03-65f6-4fe7-a187-81ec5b63637e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.619628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:31.620859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.621791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] The token cache is being invalidate because project 0481ff1d91a64d39b39d3dad413df8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:31.622157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.622887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-051cba03-65f6-4fe7-a187-81ec5b63637e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:31.625054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1000/2003] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:31 2022] DELETE /identity/v3/projects/0481ff1d91a64d39b39d3dad413df8e5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:31.630832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac5cb-fb68-449b-b52e-8b9ebe5cfeb7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.631232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac5cb-fb68-449b-b52e-8b9ebe5cfeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.631594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac5cb-fb68-449b-b52e-8b9ebe5cfeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.654276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-33dac5cb-fb68-449b-b52e-8b9ebe5cfeb7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:31.657176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-33dac5cb-fb68-449b-b52e-8b9ebe5cfeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.697875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1004/2004] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:31.710561 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.712101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.720385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:31.733599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1001/2005] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:31.741684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.742061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.742671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.770163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:31.771678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:31.780848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1002/2006] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:31.784289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d653d-13f8-4ac5-8e95-4d1e4dbfaf55 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.787554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.788119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.789348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.789348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.789348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.799270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3f8b-e02f-46d4-a6a3-a6aa87fc6dc5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.801982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.803383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.804128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.804799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.805086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.805368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.806110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:31.806419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.808071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.816342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1005/2007] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:31.831453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1003/2008] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:10:31.833333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.847118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61998867-99be-4a7f-97c4-fbcdf06383a3 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.852343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.853022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.853302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.853655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.854335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.856265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.886963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1006/2009] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:31 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:31.891296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:31.902811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d22e74-3b02-4747-817f-8b094ef407a3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:31.965628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:31.966438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:31.966735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:31.967020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:31.968453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:31.970466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:31.993519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1004/2010] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:31 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:31.998489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.010375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1e7fe-4c4f-40d7-8e84-b08a343e57b8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.015620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.016300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.016723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.017195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.017733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.019484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.031660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1007/2011] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:32.036123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.047512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56af77-2564-4285-8e7e-360d245d09a3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.054174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.054827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.055155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.055440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.056193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.057856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.070063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1005/2012] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:32.074219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.088564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901d6b5-eaf3-42cf-8383-45de3d009f0c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.094084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324ceb-29dc-4e73-9aa6-c1a67af735d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.094997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324ceb-29dc-4e73-9aa6-c1a67af735d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.095317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324ceb-29dc-4e73-9aa6-c1a67af735d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.095602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324ceb-29dc-4e73-9aa6-c1a67af735d4 admin admin] PATH_INFO: `/v3/projects/7a11dd723f5947cd95ca4759a1685fda/users/2b2df0d6743a4e51aee5c0274e686b19/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.121775 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324ceb-29dc-4e73-9aa6-c1a67af735d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a11dd723f5947cd95ca4759a1685fda, user_id=2b2df0d6743a4e51aee5c0274e686b19, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.125091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324ceb-29dc-4e73-9aa6-c1a67af735d4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.125850 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.128710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:32.142664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1008/2013] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:32 2022] PUT /identity/v3/projects/7a11dd723f5947cd95ca4759a1685fda/users/2b2df0d6743a4e51aee5c0274e686b19/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:32.153418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.153788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.154143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.154646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093a20-8c49-4af7-bc5f-7b5f249264ee admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.185365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] MFA Rules not processed for user `2b2df0d6743a4e51aee5c0274e686b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:32.187309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:32.195045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:32.231641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.235015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.235455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.235876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] PATH_INFO: `/v3/projects/3b486b69233d46dfb420298418a597e5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.238178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b486b69233d46dfb420298418a597e5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.240670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.267656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1009/2014] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:32.272111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.285058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0640b-c18f-41e3-8c47-2aed273de6ea None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.296919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b486b69233d46dfb420298418a597e5', 'request_id': 'req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.303956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b486b69233d46dfb420298418a597e5', 'request_id': 'req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.309021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:32.310372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b486b69233d46dfb420298418a597e5', 'request_id': 'req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.326349 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] The token cache is being invalidate because project 3b486b69233d46dfb420298418a597e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:32.326751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.327549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.329325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1006/2015] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:32 2022] DELETE /identity/v3/projects/3b486b69233d46dfb420298418a597e5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:32.333331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.335229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:32.356445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.357260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.357549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.358489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.359344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.361269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.391412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1010/2016] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:32 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:32.395554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.397463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:32.410719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d034-01a7-4bc5-8c0e-04c86afbd1aa admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.474738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8aa5-b80c-4753-9b95-ce30eb1a0399 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.478920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.479966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.480247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.480441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.480813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] PATH_INFO: `/v3/users/7728e1bbd46a413399715f8943cadaef` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.481204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.481634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.481930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.482459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7728e1bbd46a413399715f8943cadaef)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.482639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.486024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.486211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.515442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1011/2017] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:32 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:32.517278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.529500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787f4c-3210-4af0-96d6-b909f006b382 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.536464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.537368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.537792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.538231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.539543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.541008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.556444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1012/2018] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:32.562823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.562985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7728e1bbd46a413399715f8943cadaef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.572048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7728e1bbd46a413399715f8943cadaef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.572965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7728e1bbd46a413399715f8943cadaef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.574648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33a8fd-a445-4635-a7cd-8f245ac910f3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.580687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.582113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.582405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.582689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] PATH_INFO: `/v3/projects/7ad3d5adc0624eb581b41b1991b051c1/users/9f5d2d300cc742e79afeef7ae005e326/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.588637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7728e1bbd46a413399715f8943cadaef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.589514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7728e1bbd46a413399715f8943cadaef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:32.594957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:32.603744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad3d5adc0624eb581b41b1991b051c1, user_id=9f5d2d300cc742e79afeef7ae005e326, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.606619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1007/2019] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:32 2022] DELETE /identity/v3/users/7728e1bbd46a413399715f8943cadaef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:32.610319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.627484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1013/2020] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:32 2022] PUT /identity/v3/projects/7ad3d5adc0624eb581b41b1991b051c1/users/9f5d2d300cc742e79afeef7ae005e326/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:32.632206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.633144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:32.659935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:32.725822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecd430-bbca-4aef-a00b-2d8cd68a7b30 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.790718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d5292-c342-46f3-bf58-1dd2c3e21cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.791553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5292-c342-46f3-bf58-1dd2c3e21cee admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.791936 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5292-c342-46f3-bf58-1dd2c3e21cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.792400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5292-c342-46f3-bf58-1dd2c3e21cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.794539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d5292-c342-46f3-bf58-1dd2c3e21cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.796889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d5292-c342-46f3-bf58-1dd2c3e21cee admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.808871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1008/2021] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:32.814354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.825140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07223a-2763-43e7-947c-cc714f7eb114 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:32.831188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:32.832270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.832657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.833036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] PATH_INFO: `/v3/projects/7ad3d5adc0624eb581b41b1991b051c1/users/9f5d2d300cc742e79afeef7ae005e326/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.835268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad3d5adc0624eb581b41b1991b051c1, user_id=9f5d2d300cc742e79afeef7ae005e326, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:32.838172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:32.852397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1014/2022] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:32 2022] PUT /identity/v3/projects/7ad3d5adc0624eb581b41b1991b051c1/users/9f5d2d300cc742e79afeef7ae005e326/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:32.865209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:32.865755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:32.866136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:32.895302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] MFA Rules not processed for user `9f5d2d300cc742e79afeef7ae005e326`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:32.896772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:32.940824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:32.942730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.002583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1009/2023] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:33.014587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.020800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.024960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff14dd-2cd9-4f8e-a10f-e265b1ef2b07 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.030455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.031476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.035212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.035212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] PATH_INFO: `/v3/projects/d962380df4e242ff8fbdc75f3fb76906` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.037531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d962380df4e242ff8fbdc75f3fb76906)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.040035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.085988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:33.100097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd962380df4e242ff8fbdc75f3fb76906', 'request_id': 'req-2fa3a189-0814-4e2b-a085-2c5337123bfd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:33.100752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582cf6-697e-4dfd-8f73-ee05f757caa7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.114812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd962380df4e242ff8fbdc75f3fb76906', 'request_id': 'req-2fa3a189-0814-4e2b-a085-2c5337123bfd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:33.122878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd962380df4e242ff8fbdc75f3fb76906', 'request_id': 'req-2fa3a189-0814-4e2b-a085-2c5337123bfd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:33.136720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] The token cache is being invalidate because project d962380df4e242ff8fbdc75f3fb76906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:33.137014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:33.137687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2fa3a189-0814-4e2b-a085-2c5337123bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:33.140495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1015/2024] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:32 2022] DELETE /identity/v3/projects/d962380df4e242ff8fbdc75f3fb76906 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:33.144986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ff4b-919e-4e08-ad5a-7eaa81d43a6d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.145323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ff4b-919e-4e08-ad5a-7eaa81d43a6d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.145603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ff4b-919e-4e08-ad5a-7eaa81d43a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.159298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.159964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.160256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.160542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.162387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.165276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7125ff4b-919e-4e08-ad5a-7eaa81d43a6d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:33.168062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7125ff4b-919e-4e08-ad5a-7eaa81d43a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.232900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1016/2025] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:33.233298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.234715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.244076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.244486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.244869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.245449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1010/2026] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:33.255365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:33.272719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:33.275023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.284570 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1017/2027] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:33.300191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.303044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.305155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.312174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439195-c8dd-4649-9331-8ac73c10f3d9 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.317857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0da099-09a2-41d2-bbe4-cc55f00ce9b0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.318153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.318913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.319468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.319912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.320733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:33.321054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.322712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.323058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.323744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.324029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.324468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.326123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.336100 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1011/2028] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:33.340035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.350761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b65a9-3fb0-45b0-8854-2c3e65025e70 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.355582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.356237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.356546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.356798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.357499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.359861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.389969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1012/2029] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:33.392544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.394115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.394258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.404112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1018/2030] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:33.461315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcaa61-21b1-42cd-9242-85549b052fc7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.466768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.467955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.468244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.468524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.469226 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.471260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.496312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1013/2031] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:33.501044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.515755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525533-e628-42b8-814a-4b7d42e5cb0e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.521293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.521995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.522320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.522662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.523814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.525607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.537688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1019/2032] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:33.541819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.549151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:33.553128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7416e-9ba5-4cd2-accb-eef241b1daf0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.561996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc512679-5cf7-40bb-905e-c2644e4df469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.562742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc512679-5cf7-40bb-905e-c2644e4df469 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.563027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc512679-5cf7-40bb-905e-c2644e4df469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.563637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc512679-5cf7-40bb-905e-c2644e4df469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.564130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc512679-5cf7-40bb-905e-c2644e4df469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.566679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc512679-5cf7-40bb-905e-c2644e4df469 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.581197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1014/2033] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:33.582595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.593760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3279d-93f3-4e6d-aeed-ca44cfbf5764 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.598723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.599752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.600019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.600294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] PATH_INFO: `/v3/projects/040120971371435aa7bb937029b8e216/users/c844e3c544cb426fb9dd7d0665a7e1bd/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.618119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040120971371435aa7bb937029b8e216, user_id=c844e3c544cb426fb9dd7d0665a7e1bd, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.621130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.636758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1020/2034] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:33 2022] PUT /identity/v3/projects/040120971371435aa7bb937029b8e216/users/c844e3c544cb426fb9dd7d0665a7e1bd/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:33.647458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.648209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.648505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.684692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] MFA Rules not processed for user `c844e3c544cb426fb9dd7d0665a7e1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:33.689109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:33.778295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1015/2035] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:33.784173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.848459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15f9e-f97e-457f-b007-37425f1c45c8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.854050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.854846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.855307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.855648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.856602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.859714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.885981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1021/2036] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:33.891027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:33.902201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122b0e-34a6-42a1-9a05-78ef62168876 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:33.966919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:33.966919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:33.966919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:33.966919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:33.967481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:33.968402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:33.994175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1016/2037] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:33 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:33.998176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.010325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c3be-9f25-4ec6-8539-41a74e109776 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.015147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.015825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.016114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.016397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.017199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.018814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.030105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1022/2038] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:34.034437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.044505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa259-1007-47a5-930e-abe1f59b041a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.050650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702737c-2433-4623-a5cc-07113b70c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.051357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702737c-2433-4623-a5cc-07113b70c235 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.051648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702737c-2433-4623-a5cc-07113b70c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.051986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702737c-2433-4623-a5cc-07113b70c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.052794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702737c-2433-4623-a5cc-07113b70c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.054345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702737c-2433-4623-a5cc-07113b70c235 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.068746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1017/2039] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:34.070458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.081882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92522-90b4-493e-8be9-7c5efc7815b0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.087436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.088373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.088658 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.088935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] PATH_INFO: `/v3/projects/a51a5bc55e994e4780f323c416cbdad8/users/841d86564b894774aaf3e1733a63fa32/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.107719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51a5bc55e994e4780f323c416cbdad8, user_id=841d86564b894774aaf3e1733a63fa32, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.111032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.131630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1023/2040] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:34 2022] PUT /identity/v3/projects/a51a5bc55e994e4780f323c416cbdad8/users/841d86564b894774aaf3e1733a63fa32/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:34.143819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.144114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.144400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.176001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] MFA Rules not processed for user `841d86564b894774aaf3e1733a63fa32`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:34.177390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:34.234660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:34.252791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1018/2041] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:34.257242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.269901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:34.333128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197e1f3-7c35-4bac-a4ba-039c5cde4c5d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.337976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.338660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.338956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.339273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.339996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.341898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.371886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1024/2042] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:34 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:34.375797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.387517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63808a-0e33-4af6-b7b2-4363c40dc014 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.449095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.449778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.450066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.450347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.451060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.453291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.473542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1019/2043] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:34 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:34.477459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.488494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e32f8-6c73-4c1b-980a-a3d1a6f7246c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.493207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.493864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.494228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.494519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.495277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.496891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.508565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1025/2044] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:34.512738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.522912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0156b-94aa-4971-b4b3-c8e7c7696997 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.527855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.528732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.529013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.529287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] PATH_INFO: `/v3/projects/c6be891f141f4bfc905aa1f312609deb/users/e816862bfc2440b0a2a664c272cd53c9/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.546575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6be891f141f4bfc905aa1f312609deb, user_id=e816862bfc2440b0a2a664c272cd53c9, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.549297 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.562523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1020/2045] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:34 2022] PUT /identity/v3/projects/c6be891f141f4bfc905aa1f312609deb/users/e816862bfc2440b0a2a664c272cd53c9/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:34.566480 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.577314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bffb1-9d74-4a5a-bda9-36a9bb3f59b2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.635025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f067d48-7ab2-4a96-80b9-36dfd9422b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.635688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f067d48-7ab2-4a96-80b9-36dfd9422b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.635905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f067d48-7ab2-4a96-80b9-36dfd9422b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.636181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f067d48-7ab2-4a96-80b9-36dfd9422b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.636908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f067d48-7ab2-4a96-80b9-36dfd9422b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.638496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f067d48-7ab2-4a96-80b9-36dfd9422b3c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.649748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1026/2046] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:34.653937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.666113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4ebf2-4bef-42dc-be96-f8550bda71d0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.671526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.672542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.672755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.673038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] PATH_INFO: `/v3/projects/c6be891f141f4bfc905aa1f312609deb/users/e816862bfc2440b0a2a664c272cd53c9/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.675038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6be891f141f4bfc905aa1f312609deb, user_id=e816862bfc2440b0a2a664c272cd53c9, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:34.677740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:34.689903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1021/2047] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:34 2022] PUT /identity/v3/projects/c6be891f141f4bfc905aa1f312609deb/users/e816862bfc2440b0a2a664c272cd53c9/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:34.704244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.704596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.704889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:34.731269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] MFA Rules not processed for user `e816862bfc2440b0a2a664c272cd53c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:34.732496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:34.820022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1027/2048] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:34.851613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:34.851613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:34.928248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1ddd-1a4a-42a4-aa6e-c08711acc957 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:34.932397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdee0fe-0df3-4dba-9e02-71dbba647e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:34.933381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee0fe-0df3-4dba-9e02-71dbba647e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:34.933697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee0fe-0df3-4dba-9e02-71dbba647e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:34.934091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee0fe-0df3-4dba-9e02-71dbba647e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:35.014810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdee0fe-0df3-4dba-9e02-71dbba647e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:35.016324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdee0fe-0df3-4dba-9e02-71dbba647e58 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:35.020392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:35.030307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1022/2049] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:36.852098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:36.853612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:36.863811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:36.924147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b41ec-7b22-4507-aa41-e8969ab38fad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:36.929244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:36.930363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:36.930850 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:36.931265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] PATH_INFO: `/v3/users/2b2df0d6743a4e51aee5c0274e686b19` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:36.932718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2df0d6743a4e51aee5c0274e686b19)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:36.934695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:36.997519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2df0d6743a4e51aee5c0274e686b19'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:36.997519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2df0d6743a4e51aee5c0274e686b19'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.000461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2df0d6743a4e51aee5c0274e686b19'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.001156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2df0d6743a4e51aee5c0274e686b19'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.009623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2df0d6743a4e51aee5c0274e686b19'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.028461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1028/2050] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:36 2022] DELETE /identity/v3/users/2b2df0d6743a4e51aee5c0274e686b19 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:37.033385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:37.033978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:37.033978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:37.055653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:37.056856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:37.126605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1023/2051] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:37.136303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:37.137724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:37.198093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec4ee-1105-46d5-b472-f050c5efddcf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:37.201828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:37.202621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:37.202909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:37.203227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:37.212687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:37.214248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:37.226326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1029/2052] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:37.513719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:37.515674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:37.531945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3decb-35a2-4e8f-81c3-4b5dea36e8a6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:37.540254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:37.541146 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:37.541490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:37.541774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] PATH_INFO: `/v3/projects/7a11dd723f5947cd95ca4759a1685fda` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:37.544266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a11dd723f5947cd95ca4759a1685fda)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:37.546981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:37.601622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a11dd723f5947cd95ca4759a1685fda', 'request_id': 'req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.610547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a11dd723f5947cd95ca4759a1685fda', 'request_id': 'req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.616784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a11dd723f5947cd95ca4759a1685fda', 'request_id': 'req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.637103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] The token cache is being invalidate because project 7a11dd723f5947cd95ca4759a1685fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:37.637478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.638211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.640455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1024/2053] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:37 2022] DELETE /identity/v3/projects/7a11dd723f5947cd95ca4759a1685fda => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:37.644308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:37.656930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fda2d-2fd1-432d-a449-91ddda1e140a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:37.684337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:37.721529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:37.722412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:37.722697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:37.722977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] PATH_INFO: `/v3/users/9f5d2d300cc742e79afeef7ae005e326` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:37.724213 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5d2d300cc742e79afeef7ae005e326)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:37.726119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:37.744454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:37.745848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:37.790572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5d2d300cc742e79afeef7ae005e326'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.791355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5d2d300cc742e79afeef7ae005e326'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.800778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5d2d300cc742e79afeef7ae005e326'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.801539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5d2d300cc742e79afeef7ae005e326'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.810433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5d2d300cc742e79afeef7ae005e326'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:37.817775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d338b-c26e-4aeb-acdb-dc0ee9eb5d02 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:37.823614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:37.824323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:37.824617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:37.824934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:37.827471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:37.829933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1030/2054] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:37 2022] DELETE /identity/v3/users/9f5d2d300cc742e79afeef7ae005e326 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:37.873280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:37.911375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:37.913474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6fead-6b88-4a37-b56b-3a6b5e0de488 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:37.925252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1025/2055] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:38.176309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.178879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:38.277763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f84c-3742-40aa-ba30-f2d217842058 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.284805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.285846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.286058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.286312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] PATH_INFO: `/v3/projects/7ad3d5adc0624eb581b41b1991b051c1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.287610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad3d5adc0624eb581b41b1991b051c1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.289584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.352355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad3d5adc0624eb581b41b1991b051c1', 'request_id': 'req-c9addc4d-c33c-40af-b3be-28eab8b0a951'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:38.354264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:38.364042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad3d5adc0624eb581b41b1991b051c1', 'request_id': 'req-c9addc4d-c33c-40af-b3be-28eab8b0a951'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:38.373938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad3d5adc0624eb581b41b1991b051c1', 'request_id': 'req-c9addc4d-c33c-40af-b3be-28eab8b0a951'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:38.388495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] The token cache is being invalidate because project 7ad3d5adc0624eb581b41b1991b051c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:38.390874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:38.391714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c9addc4d-c33c-40af-b3be-28eab8b0a951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:38.394157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1031/2056] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:38 2022] DELETE /identity/v3/projects/7ad3d5adc0624eb581b41b1991b051c1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:38.399458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.400069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.400355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.433181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:38.434505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:38.529532 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1026/2057] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:38.539020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.539408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.539656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.572137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:38.574101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:38.588405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1032/2058] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:38.595485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.610584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b1296-9cae-400a-a82e-e7113631a0d2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.639920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.640629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.640928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.641215 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.641971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:38.642289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.648163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.665433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1027/2059] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:38.669941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.680146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd00c-eaa1-4d36-b0b7-d8bc8e7fa55d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.685506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.686311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.686578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.686857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.687592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.689624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.735752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1033/2060] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:38 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:38.740049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.753527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6799116-db22-42be-ace8-c62b5e550ef8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.802643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.805766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:38.826302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.827905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.828134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.828415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.829138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.831167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.853701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1028/2061] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:38 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:38.858005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.869817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc94316-05f9-4296-a9d9-9d9fbfcd269e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.875302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.876314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.876610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.876895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.877650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.878897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a21a4-50e3-4b8d-bb53-4dfe198642ed admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.879383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.883525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.884229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.884511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.884785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.886783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:38.895080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1029/2062] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:38.896447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.907500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b501f-bfb2-465b-81b0-99ca7c2ba774 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.915601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.916335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.916625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.916906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.917648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.919995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.935666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1030/2063] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:38.937388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:38.948909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df9aa-e61f-409f-97a5-ab3c7cfa162d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:38.954784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:38.955742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:38.956031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:38.956312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] PATH_INFO: `/v3/projects/2a78d7c5250a4000ac8ce845c5d631cf/users/527b012a94714fca986116212161abac/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:38.961811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.963697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81ea65-0647-4154-8230-8fb9e7791d6c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.976814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a78d7c5250a4000ac8ce845c5d631cf, user_id=527b012a94714fca986116212161abac, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:38.979632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:38.984860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1034/2064] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:38.990714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:39.000876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1031/2065] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:38 2022] PUT /identity/v3/projects/2a78d7c5250a4000ac8ce845c5d631cf/users/527b012a94714fca986116212161abac/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:39.011734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.012095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.012441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.046176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] MFA Rules not processed for user `527b012a94714fca986116212161abac`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:39.047178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:39.114128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:39.146899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1035/2066] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:10:39.151986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.234611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58eb4b-17ef-4c50-a11f-7c489f69014e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.242133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.244447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.244757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.245050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.245831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.247996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.283573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1032/2067] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:39 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:39.288942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.303469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41ced-e4b1-4fbc-b798-ad4c020eda90 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.380217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.382693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.382693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.382693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.382693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.384174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.411144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1036/2068] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:39 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:39.412376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.423456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2739c-c2ca-475b-bceb-b067381767ae admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.430047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.431269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.431808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.432390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.433845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.437365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.456054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1033/2069] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:39.460514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.471021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48601be-4575-430e-8539-bdf71da956db admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.476466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b79e1-2439-4a71-863e-e57d11e6b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.477320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b79e1-2439-4a71-863e-e57d11e6b0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.477663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b79e1-2439-4a71-863e-e57d11e6b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.477965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b79e1-2439-4a71-863e-e57d11e6b0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.478811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b79e1-2439-4a71-863e-e57d11e6b0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.482130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b79e1-2439-4a71-863e-e57d11e6b0b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.500270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1037/2070] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:39.502277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.518625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470e2c-93f3-4e0c-b74e-2b6266daded0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.533438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.534431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.534718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.535142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] PATH_INFO: `/v3/projects/70c18b47121942988c6cc93b83f41da1/users/75485f6cecc141b7a8e1715e132066d8/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.559330 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c18b47121942988c6cc93b83f41da1, user_id=75485f6cecc141b7a8e1715e132066d8, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.563881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.584431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1034/2071] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:39 2022] PUT /identity/v3/projects/70c18b47121942988c6cc93b83f41da1/users/75485f6cecc141b7a8e1715e132066d8/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:39.596525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.596823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.597113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.635576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] MFA Rules not processed for user `75485f6cecc141b7a8e1715e132066d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:39.637009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:39.724750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1038/2072] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:39.729065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.804312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ebc00-7c98-422b-aaa7-32cfe8c8de56 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.810613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.812125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.812416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.812701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.813463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.815483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.852344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1035/2073] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:39 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:39.858687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.871210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12943a4-d547-4f60-b454-84acd22d389d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.936703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:39.944727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:39.945433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:39.945734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:39.947527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:39.948510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:39.950662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:39.975160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1039/2074] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:39 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:39.981201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:39.993899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93d9a3-9926-4959-a73e-c20b9740f790 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:39.999771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:40.000513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:40.000801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:40.001194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:40.001854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:40.003514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:40.019486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1036/2075] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:40.023791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:40.036349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50a20e-87c5-4163-881b-4eeff8d07e30 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:40.041662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:40.042673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:40.043039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:40.043481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] PATH_INFO: `/v3/projects/6ace28297706462fb60bdab0eab6f5ad/users/1b50536962b74ab09813a1d73afe9934/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:40.061928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ace28297706462fb60bdab0eab6f5ad, user_id=1b50536962b74ab09813a1d73afe9934, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:40.064863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:40.080230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1040/2076] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:40 2022] PUT /identity/v3/projects/6ace28297706462fb60bdab0eab6f5ad/users/1b50536962b74ab09813a1d73afe9934/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:40.084824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:40.095661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334120c2-a49f-4ec9-88d1-d7ceefc4a72f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:40.121216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:40.220941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944cb74-7251-4923-9113-f0ba190ecd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:40.221769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cb74-7251-4923-9113-f0ba190ecd44 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:40.222060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cb74-7251-4923-9113-f0ba190ecd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:40.222343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cb74-7251-4923-9113-f0ba190ecd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:40.223112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944cb74-7251-4923-9113-f0ba190ecd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:40.224795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944cb74-7251-4923-9113-f0ba190ecd44 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:40.240487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1037/2077] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:40.241736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:40.253631 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b5ef-be48-43f3-835b-933d1a10d253 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:40.263132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:40.263132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:40.263132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:40.263519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] PATH_INFO: `/v3/projects/6ace28297706462fb60bdab0eab6f5ad/users/1b50536962b74ab09813a1d73afe9934/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:40.265647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ace28297706462fb60bdab0eab6f5ad, user_id=1b50536962b74ab09813a1d73afe9934, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:40.268948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:40.281882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1041/2078] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:40 2022] PUT /identity/v3/projects/6ace28297706462fb60bdab0eab6f5ad/users/1b50536962b74ab09813a1d73afe9934/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:40.296409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:40.296848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:40.297198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:40.337199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] MFA Rules not processed for user `1b50536962b74ab09813a1d73afe9934`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:40.338462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:40.420227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1038/2079] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:40.431933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:40.438448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:40.509470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe169dfa-46fb-48a6-acf2-bb7ba87992eb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:40.513358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:40.514063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:40.514357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:40.514629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:40.524731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:40.526194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:40.537385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1042/2080] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:41.071924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:41.082879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800aa22d-3f68-4908-8ba7-f833a6c43ea4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:41.086649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70514fd-e129-4184-b26b-9bc659dd86d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:41.087328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70514fd-e129-4184-b26b-9bc659dd86d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:41.087622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70514fd-e129-4184-b26b-9bc659dd86d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:41.087924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70514fd-e129-4184-b26b-9bc659dd86d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:41.145949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70514fd-e129-4184-b26b-9bc659dd86d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:41.147453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70514fd-e129-4184-b26b-9bc659dd86d4 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:41.157097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1039/2081] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:44.051784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:44.053320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:44.119693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55596-128a-494b-98d0-15c9c39c6afc service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:44.124400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:44.125265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:44.125552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:44.125832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] PATH_INFO: `/v3/users/c844e3c544cb426fb9dd7d0665a7e1bd` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:44.127031 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c844e3c544cb426fb9dd7d0665a7e1bd)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:44.128990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:44.177012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c844e3c544cb426fb9dd7d0665a7e1bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.177747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c844e3c544cb426fb9dd7d0665a7e1bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.183473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:44.185693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c844e3c544cb426fb9dd7d0665a7e1bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.187511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c844e3c544cb426fb9dd7d0665a7e1bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.196587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c844e3c544cb426fb9dd7d0665a7e1bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.215523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1043/2082] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:44 2022] DELETE /identity/v3/users/c844e3c544cb426fb9dd7d0665a7e1bd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:44.220627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766838a5-925b-4973-8a85-e427faab2185 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:44.221133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766838a5-925b-4973-8a85-e427faab2185 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:44.221260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766838a5-925b-4973-8a85-e427faab2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:44.242306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-766838a5-925b-4973-8a85-e427faab2185 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:44.243577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-766838a5-925b-4973-8a85-e427faab2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:44.286728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:44.309830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1040/2083] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:44.319938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:44.321333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:44.379781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de654-cf37-47a3-b85d-12153987f1fa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:44.383590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:44.384360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:44.384710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:44.384991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:44.395152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:44.396574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:44.407116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1044/2084] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:44.673144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766838a5-925b-4973-8a85-e427faab2185 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:44.674567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-766838a5-925b-4973-8a85-e427faab2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:44.687684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766838a5-925b-4973-8a85-e427faab2185 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:44.692317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:44.693279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:44.693430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:44.693698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] PATH_INFO: `/v3/projects/040120971371435aa7bb937029b8e216` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:44.694968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=040120971371435aa7bb937029b8e216)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:44.697521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:44.753307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040120971371435aa7bb937029b8e216', 'request_id': 'req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.759631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040120971371435aa7bb937029b8e216', 'request_id': 'req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.766891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040120971371435aa7bb937029b8e216', 'request_id': 'req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.782589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] The token cache is being invalidate because project 040120971371435aa7bb937029b8e216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:44.782878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.783525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.785255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1041/2085] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:44 2022] DELETE /identity/v3/projects/040120971371435aa7bb937029b8e216 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:44.789146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:44.799497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e090-eab9-40d8-a842-23a081f014b9 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:44.862566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:44.863601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:44.863954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:44.864226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] PATH_INFO: `/v3/users/841d86564b894774aaf3e1733a63fa32` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:44.865516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841d86564b894774aaf3e1733a63fa32)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:44.867560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:44.927891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841d86564b894774aaf3e1733a63fa32'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.928556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841d86564b894774aaf3e1733a63fa32'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.946207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841d86564b894774aaf3e1733a63fa32'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.947120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841d86564b894774aaf3e1733a63fa32'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.957337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841d86564b894774aaf3e1733a63fa32'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:44.970745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:44.981578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1045/2086] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:44 2022] DELETE /identity/v3/users/841d86564b894774aaf3e1733a63fa32 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:45.265979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:45.267456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:45.282048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d583-f8c6-478a-8d5d-95f3f0e2b2ce admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:45.342135 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:45.343049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:45.343369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:45.343648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] PATH_INFO: `/v3/projects/a51a5bc55e994e4780f323c416cbdad8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:45.344968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51a5bc55e994e4780f323c416cbdad8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:45.347079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:45.395950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51a5bc55e994e4780f323c416cbdad8', 'request_id': 'req-2d6ea916-5401-40db-8ee7-c7c120ec7b67'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.402718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51a5bc55e994e4780f323c416cbdad8', 'request_id': 'req-2d6ea916-5401-40db-8ee7-c7c120ec7b67'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.409439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51a5bc55e994e4780f323c416cbdad8', 'request_id': 'req-2d6ea916-5401-40db-8ee7-c7c120ec7b67'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.413180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:45.426873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] The token cache is being invalidate because project a51a5bc55e994e4780f323c416cbdad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:45.427218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.427883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.429655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1042/2087] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:45 2022] DELETE /identity/v3/projects/a51a5bc55e994e4780f323c416cbdad8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:45.433447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:45.434885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:45.449186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a920-0429-4b2d-ba2d-e391c9961497 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:45.511642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:45.512534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:45.512825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:45.513104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] PATH_INFO: `/v3/users/e816862bfc2440b0a2a664c272cd53c9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:45.514393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e816862bfc2440b0a2a664c272cd53c9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:45.516348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:45.564744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e816862bfc2440b0a2a664c272cd53c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.565428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e816862bfc2440b0a2a664c272cd53c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.572536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e816862bfc2440b0a2a664c272cd53c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.573205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e816862bfc2440b0a2a664c272cd53c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.581226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-636fabdc-84c3-46a0-8982-4f798bcab816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e816862bfc2440b0a2a664c272cd53c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:45.599148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1046/2088] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:45 2022] DELETE /identity/v3/users/e816862bfc2440b0a2a664c272cd53c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:45.867282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:45.868841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:45.881762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ea916-5401-40db-8ee7-c7c120ec7b67 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:45.940811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:45.941685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:45.941975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:45.942257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] PATH_INFO: `/v3/projects/c6be891f141f4bfc905aa1f312609deb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:45.943615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6be891f141f4bfc905aa1f312609deb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:45.945477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:45.997204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6be891f141f4bfc905aa1f312609deb', 'request_id': 'req-e612e901-6de0-4a79-a57c-eae1a0111636'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:46.004500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6be891f141f4bfc905aa1f312609deb', 'request_id': 'req-e612e901-6de0-4a79-a57c-eae1a0111636'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:46.010341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6be891f141f4bfc905aa1f312609deb', 'request_id': 'req-e612e901-6de0-4a79-a57c-eae1a0111636'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:46.025087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] The token cache is being invalidate because project c6be891f141f4bfc905aa1f312609deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:46.025388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:46.026039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e612e901-6de0-4a79-a57c-eae1a0111636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:46.034057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1043/2089] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:45 2022] DELETE /identity/v3/projects/c6be891f141f4bfc905aa1f312609deb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:46.039305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.039764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.040228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.063590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:46.064796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:46.122886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1047/2090] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:46.131790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.132082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.132363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.151867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:46.153080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:46.161150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1044/2091] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:46.165688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.176099 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941259-3161-4e2d-bfa2-9077b22d2327 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.180847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.181503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.181788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.182070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.182832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:46.183263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.184871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.194995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:46.198805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1048/2092] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:46.203791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.213456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077702c9-e852-4ece-adca-04ff22147e7c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.219291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.220109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.220394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.220671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.221369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.223421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.252389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1045/2093] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:46 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:46.254698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.265247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09de5-789b-431d-9a7b-0e294495aa33 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.325681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.326459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.326902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.327129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.327830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.329764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.349696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1049/2094] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:46 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:46.353793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.365416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b43ca6-4e38-4a40-bfa4-19d7fc7aa135 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.370262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.370969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.371326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.371613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.372351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.374003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.384535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1046/2095] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:46.388636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.399466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209970ec-6e43-4aef-bde2-c535b701707b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.404792 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e7256-3ce0-417b-9db5-9e58879b0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.405486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7256-3ce0-417b-9db5-9e58879b0b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.405747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7256-3ce0-417b-9db5-9e58879b0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.406023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7256-3ce0-417b-9db5-9e58879b0b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.406748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e7256-3ce0-417b-9db5-9e58879b0b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.408399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e7256-3ce0-417b-9db5-9e58879b0b2c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.418526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1050/2096] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:46.423318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.433462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952ec8-4d81-4e91-95df-3fc89fa33eb1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.438619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.439543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.439831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.440115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] PATH_INFO: `/v3/projects/7ea454dd40064a02afef0dcc50652fa7/users/e8039e6bfde34584a442cbc12a02129b/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.454738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea454dd40064a02afef0dcc50652fa7, user_id=e8039e6bfde34584a442cbc12a02129b, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.457392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.471326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1047/2097] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:46 2022] PUT /identity/v3/projects/7ea454dd40064a02afef0dcc50652fa7/users/e8039e6bfde34584a442cbc12a02129b/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:46.482093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.483142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.483334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.511475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] MFA Rules not processed for user `e8039e6bfde34584a442cbc12a02129b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:46.512684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:46.585835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1051/2098] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:46.597634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:46.600037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:46.634766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:46.674127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0d8d-cbf5-4052-b850-37a4544e3423 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:46.678322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:46.679194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:46.679484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:46.679763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:46.695028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:46.696523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:46.707502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1048/2099] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:47.282324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:47.283842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:47.297525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a3969-0f07-476e-ba4e-5050aac3610b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:47.301815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:47.302523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:47.302832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:47.303452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:47.305370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:47.369961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:47.371604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b35ea0-6061-47b1-af79-7c009d56e405 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:47.382108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1052/2100] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:47.935505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:47.936941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:48.009055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a9976-0dda-48a1-bd70-279901b2bc16 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:48.013793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:48.014684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.014975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.015289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] PATH_INFO: `/v3/users/418c30d6960045cea7c810daa4c4c175` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.016503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=418c30d6960045cea7c810daa4c4c175)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:48.018457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:48.079638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418c30d6960045cea7c810daa4c4c175'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.093702 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418c30d6960045cea7c810daa4c4c175'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.094438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418c30d6960045cea7c810daa4c4c175'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.110002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418c30d6960045cea7c810daa4c4c175'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.110856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418c30d6960045cea7c810daa4c4c175'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.124788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1049/2101] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:47 2022] DELETE /identity/v3/users/418c30d6960045cea7c810daa4c4c175 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:48.129389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.129878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.130067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.143335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:48.150655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:48.152065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:48.214425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1053/2102] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:48.225132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:48.226553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:48.280679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:48.304571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6233754-8bac-43d6-bd94-4e29c1a18cfa admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:48.311104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5f8d-a112-4f7b-bb89-dcb4f1c24727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:48.312518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5f8d-a112-4f7b-bb89-dcb4f1c24727 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.313173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5f8d-a112-4f7b-bb89-dcb4f1c24727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.314225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5f8d-a112-4f7b-bb89-dcb4f1c24727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.324367 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b5f8d-a112-4f7b-bb89-dcb4f1c24727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:48.327134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b5f8d-a112-4f7b-bb89-dcb4f1c24727 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:48.338318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1050/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:10:48.645472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:48.646987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:48.659746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33318a3-e1a4-4993-b314-05ef95398a6d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:48.664491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:48.665499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.665789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.666084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] PATH_INFO: `/v3/projects/9d6d066dfcef445fad603f1aa276a3f7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.667387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6d066dfcef445fad603f1aa276a3f7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:48.669315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:48.719021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6d066dfcef445fad603f1aa276a3f7', 'request_id': 'req-537ec2c9-f5d7-4c21-93ea-f3d921a76569'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.726937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6d066dfcef445fad603f1aa276a3f7', 'request_id': 'req-537ec2c9-f5d7-4c21-93ea-f3d921a76569'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.734090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6d066dfcef445fad603f1aa276a3f7', 'request_id': 'req-537ec2c9-f5d7-4c21-93ea-f3d921a76569'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.744797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] The token cache is being invalidate because project 9d6d066dfcef445fad603f1aa276a3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:48.745085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.745741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-537ec2c9-f5d7-4c21-93ea-f3d921a76569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:48.747344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1054/2104] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:48 2022] DELETE /identity/v3/projects/9d6d066dfcef445fad603f1aa276a3f7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:48.752879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.753262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.753546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.772209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:48.773621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:48.835412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1051/2105] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:48.844450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.844750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.845037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.865560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:48.866780 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:48.875682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1055/2106] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:48.880029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:48.890553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ddfe-27f0-459b-8857-9f12eb0ff9bf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:48.895210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:48.895878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.896165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.896444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.897176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:48.897487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:48.899397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:48.911663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1052/2107] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:48.916416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:48.926509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89212c05-f313-42b1-a2a4-a673b03f5e31 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:48.931292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:48.931955 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:48.932244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:48.932524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:48.933224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:48.935157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:48.965397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1056/2108] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:48 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:48.966630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:48.978563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7333c-4a01-42b3-a491-87bc4a8cd233 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.059932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.060644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.061082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.061365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.062063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:49.064082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:49.085543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1053/2109] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:48 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:49.089539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:49.100582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b288b-6e2a-46ca-8935-c183ab859634 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.105900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.106650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.107011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.107527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.108449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:49.110160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:49.124866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1057/2110] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:49.125886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:49.137252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9ca21-07a1-4b22-b5d8-01e75909ac24 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.143373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c52f4-59d7-45a1-a3d9-1013ce8de33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.144248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c52f4-59d7-45a1-a3d9-1013ce8de33d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.144667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c52f4-59d7-45a1-a3d9-1013ce8de33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.145048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c52f4-59d7-45a1-a3d9-1013ce8de33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.146061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c52f4-59d7-45a1-a3d9-1013ce8de33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:49.148206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c52f4-59d7-45a1-a3d9-1013ce8de33d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:49.163595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1054/2111] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:49.169936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:49.180210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53e7fb-fad2-4d33-849d-f922d7124408 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.185279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.186723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.187162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.187362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] PATH_INFO: `/v3/projects/a53b1a2557ab4218be7bd1fe10954cf1/users/d07723de62484a618bc76358c16c302b/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.205137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53b1a2557ab4218be7bd1fe10954cf1, user_id=d07723de62484a618bc76358c16c302b, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:49.207876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:49.221611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1058/2112] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:49 2022] PUT /identity/v3/projects/a53b1a2557ab4218be7bd1fe10954cf1/users/d07723de62484a618bc76358c16c302b/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:49.233632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.233923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.234205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.263377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] MFA Rules not processed for user `d07723de62484a618bc76358c16c302b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:49.265315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:49.312651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:49.337705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1055/2113] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:49.348959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:49.350679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:49.383182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:49.415356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482b710-5961-453e-ad70-9387df88b75e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.419609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc835810-3230-43e0-a1d1-df92a25bddac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.420962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc835810-3230-43e0-a1d1-df92a25bddac service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.421299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc835810-3230-43e0-a1d1-df92a25bddac service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.421643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc835810-3230-43e0-a1d1-df92a25bddac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.431601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc835810-3230-43e0-a1d1-df92a25bddac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:49.433215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc835810-3230-43e0-a1d1-df92a25bddac service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:49.443196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1059/2114] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:49.578428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:49.579950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:49.660628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420198b6-094f-4b98-a6c0-0fa59f219d8b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.665329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.666217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.666521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.666785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] PATH_INFO: `/v3/users/527b012a94714fca986116212161abac` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.668022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527b012a94714fca986116212161abac)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:49.670184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:49.733756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527b012a94714fca986116212161abac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:49.752282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527b012a94714fca986116212161abac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:49.756485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527b012a94714fca986116212161abac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:49.782805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527b012a94714fca986116212161abac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:49.783590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527b012a94714fca986116212161abac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:49.807681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1056/2115] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:49 2022] DELETE /identity/v3/users/527b012a94714fca986116212161abac => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:49.812515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.812817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.813111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:49.832756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:49.834048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:49.911135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1060/2116] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:49.918759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:49.920930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:49.992145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85e82-af1a-4bcf-8008-ed31517d7bc2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:49.996014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:49.996672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:49.996963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:49.997247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:50.006768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:50.008283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:50.018063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1057/2117] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:10:50.315176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:50.317986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:50.331224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fa3b6-413f-4fc7-8c51-c444848a5813 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:50.335914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:50.336981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:50.337463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:50.337898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] PATH_INFO: `/v3/projects/2a78d7c5250a4000ac8ce845c5d631cf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:50.339373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a78d7c5250a4000ac8ce845c5d631cf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:50.341256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:50.393963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a78d7c5250a4000ac8ce845c5d631cf', 'request_id': 'req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.401569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a78d7c5250a4000ac8ce845c5d631cf', 'request_id': 'req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.409490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a78d7c5250a4000ac8ce845c5d631cf', 'request_id': 'req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.420166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] The token cache is being invalidate because project 2a78d7c5250a4000ac8ce845c5d631cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:50.420595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.421254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.422815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1061/2118] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:50 2022] DELETE /identity/v3/projects/2a78d7c5250a4000ac8ce845c5d631cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:50.426918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:50.433125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:50.437755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c126bb-d651-47c0-ab81-e37ae652e071 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:50.497433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:50.499017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:50.499346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:50.499653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] PATH_INFO: `/v3/users/75485f6cecc141b7a8e1715e132066d8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:50.500890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75485f6cecc141b7a8e1715e132066d8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:50.502870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:50.549614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75485f6cecc141b7a8e1715e132066d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.556834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75485f6cecc141b7a8e1715e132066d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.557464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75485f6cecc141b7a8e1715e132066d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.570571 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75485f6cecc141b7a8e1715e132066d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.571276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75485f6cecc141b7a8e1715e132066d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:50.583723 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1058/2119] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:50 2022] DELETE /identity/v3/users/75485f6cecc141b7a8e1715e132066d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:50.863613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:50.865093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:50.879009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22807c8-155e-4ad6-9ab5-30a9c1b8b799 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:50.930333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:50.942261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:50.943431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:50.943796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:50.944335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] PATH_INFO: `/v3/projects/70c18b47121942988c6cc93b83f41da1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:50.945773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c18b47121942988c6cc93b83f41da1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:50.947722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:50.997438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c18b47121942988c6cc93b83f41da1', 'request_id': 'req-538cb05a-f867-4997-b057-c0aa4ccac7c2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.006130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c18b47121942988c6cc93b83f41da1', 'request_id': 'req-538cb05a-f867-4997-b057-c0aa4ccac7c2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.015559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c18b47121942988c6cc93b83f41da1', 'request_id': 'req-538cb05a-f867-4997-b057-c0aa4ccac7c2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.026713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] The token cache is being invalidate because project 70c18b47121942988c6cc93b83f41da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:51.027008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.027701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.029536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1062/2120] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:50 2022] DELETE /identity/v3/projects/70c18b47121942988c6cc93b83f41da1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:51.034205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:51.035887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:51.050293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8725-9f5a-4b8e-9304-a42a0b5d51a9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:51.107046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:51.108082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.108375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.108658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] PATH_INFO: `/v3/users/1b50536962b74ab09813a1d73afe9934` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.109871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b50536962b74ab09813a1d73afe9934)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:51.111860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:51.142344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:51.163884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b50536962b74ab09813a1d73afe9934'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.171043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b50536962b74ab09813a1d73afe9934'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.171824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b50536962b74ab09813a1d73afe9934'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.184776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b50536962b74ab09813a1d73afe9934'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.185420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-34b570e7-256d-490d-8339-6e333ce82af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b50536962b74ab09813a1d73afe9934'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.197772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1059/2121] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:10:51 2022] DELETE /identity/v3/users/1b50536962b74ab09813a1d73afe9934 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:51.493206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:51.494763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:51.509166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb05a-f867-4997-b057-c0aa4ccac7c2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:51.570666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:51.571573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.571854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.572124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] PATH_INFO: `/v3/projects/6ace28297706462fb60bdab0eab6f5ad` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.573297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ace28297706462fb60bdab0eab6f5ad)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:51.575229 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:51.623415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ace28297706462fb60bdab0eab6f5ad', 'request_id': 'req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.630819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ace28297706462fb60bdab0eab6f5ad', 'request_id': 'req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.637128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ace28297706462fb60bdab0eab6f5ad', 'request_id': 'req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.648556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] The token cache is being invalidate because project 6ace28297706462fb60bdab0eab6f5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:10:51.648847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.649491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ab2ba9d2-a333-428d-9eea-0f01f7700e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:10:51.651060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1063/2122] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:10:51 2022] DELETE /identity/v3/projects/6ace28297706462fb60bdab0eab6f5ad => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:51.657869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.658163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.658447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.676140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:51.677336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:51.737855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1060/2123] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:51.746258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.746550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.746828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.766579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:51.767820 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:51.776026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1064/2124] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:51.781665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:51.791609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccc2ea-7cfa-4d83-a3b0-be812f8493e0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:51.796792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:51.797453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.797745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.798027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.798826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:10:51.799198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:51.800853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:51.815467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1061/2125] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:10:51.818539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:51.828930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a32eb0-ff86-4ada-a1c2-d39f62afb99d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:51.833628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:51.834291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.834579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.834860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.835649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:51.837583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:51.840978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:51.879541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1065/2126] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:51 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:51.881412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:51.893731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05241ce2-180c-4c03-acbc-61376cb3d990 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:51.973516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:51.974340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:51.975179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:51.975179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:51.975997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:51.978260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.002802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1062/2127] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:51 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:52.006949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.024215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0fed-a731-47cb-8e76-073016f3fa2a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.030579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.036966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.036966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.036966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.036966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.036966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.051185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1066/2128] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:52.054979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.067139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de237a-1644-468c-a53a-2b07c50ee710 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.072328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857d813-7f78-42b1-a220-47eb947ad70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.073117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857d813-7f78-42b1-a220-47eb947ad70d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.073576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857d813-7f78-42b1-a220-47eb947ad70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.073935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857d813-7f78-42b1-a220-47eb947ad70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.074885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857d813-7f78-42b1-a220-47eb947ad70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.077431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857d813-7f78-42b1-a220-47eb947ad70d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.090638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1063/2129] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:10:52.098090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.121241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb40d-833c-4e73-882f-21dd6d340687 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.131804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.132749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.133032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.133313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] PATH_INFO: `/v3/projects/3e7a6a9e32f94453a1502cc9972ec5d5/users/75b5d89e883042f1a8856ae8ca575a12/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.151575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7a6a9e32f94453a1502cc9972ec5d5, user_id=75b5d89e883042f1a8856ae8ca575a12, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.155736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.172018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1067/2130] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:52 2022] PUT /identity/v3/projects/3e7a6a9e32f94453a1502cc9972ec5d5/users/75b5d89e883042f1a8856ae8ca575a12/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:52.182886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a941-4269-44cd-8f08-2611d903755d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.183234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a941-4269-44cd-8f08-2611d903755d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.183514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a941-4269-44cd-8f08-2611d903755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.203321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:52.213659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d804a941-4269-44cd-8f08-2611d903755d None None] MFA Rules not processed for user `75b5d89e883042f1a8856ae8ca575a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:52.215324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d804a941-4269-44cd-8f08-2611d903755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:52.286329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1064/2131] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:52.287444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.352862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a4ac4-d7d4-41c0-8997-4840f1edc99d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.357665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.358330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.358625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.358932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.359788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.361526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.391944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1068/2132] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:10:52 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:10:52.394285 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a941-4269-44cd-8f08-2611d903755d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.405365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a941-4269-44cd-8f08-2611d903755d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.463256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.463934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.464223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.464505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.465216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.467370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.497418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1065/2133] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:10:52 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:10:52.499855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.510228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99715d1-3003-4f13-aced-77d54456ef63 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.517690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.518370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.518654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.518932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.519747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.521383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.537101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1069/2134] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:52.538219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.549528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce8ad-59c3-47f8-884e-a3bad306b34f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.555973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.556927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.557198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.557512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] PATH_INFO: `/v3/projects/12b4a6da86b94cb49a70e4048fae44b2/users/d726b83d1038499694047aef1d4afe5b/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.574626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b4a6da86b94cb49a70e4048fae44b2, user_id=d726b83d1038499694047aef1d4afe5b, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.577555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.593827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1066/2135] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:52 2022] PUT /identity/v3/projects/12b4a6da86b94cb49a70e4048fae44b2/users/d726b83d1038499694047aef1d4afe5b/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:10:52.597648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.608979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481dacf-b422-44b7-b4a9-56dea81169ec admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.668382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aff35-dfb9-4f41-988c-d857ed8c799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.669055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aff35-dfb9-4f41-988c-d857ed8c799b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.669340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aff35-dfb9-4f41-988c-d857ed8c799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.669617 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aff35-dfb9-4f41-988c-d857ed8c799b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.671517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aff35-dfb9-4f41-988c-d857ed8c799b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.673110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aff35-dfb9-4f41-988c-d857ed8c799b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.683242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1070/2136] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:10:52.688387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.698845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bc94-afe3-4a24-9138-9bb9c2cc351e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.704406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.705316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.705594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.705867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] PATH_INFO: `/v3/projects/12b4a6da86b94cb49a70e4048fae44b2/users/d726b83d1038499694047aef1d4afe5b/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.707906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b4a6da86b94cb49a70e4048fae44b2, user_id=d726b83d1038499694047aef1d4afe5b, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.710548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.721722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1067/2137] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:10:52 2022] PUT /identity/v3/projects/12b4a6da86b94cb49a70e4048fae44b2/users/d726b83d1038499694047aef1d4afe5b/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:10:52.732112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.733011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.733300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.761962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] MFA Rules not processed for user `d726b83d1038499694047aef1d4afe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:10:52.763222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:52.771958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:52.837112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1071/2138] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:10:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:10:52.848370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:10:52.850145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:10:52.909518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165b8c-2f6f-423a-aa85-73c7b4650e9e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:10:52.913276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2638cf-a239-4496-9987-edcf52378736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:10:52.913941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2638cf-a239-4496-9987-edcf52378736 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:10:52.914233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2638cf-a239-4496-9987-edcf52378736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:10:52.914518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2638cf-a239-4496-9987-edcf52378736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:10:52.918801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:52.977176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2638cf-a239-4496-9987-edcf52378736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:10:52.978690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2638cf-a239-4496-9987-edcf52378736 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:10:52.988872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1068/2139] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:10:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:02.834069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:02.984437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=25 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:09.516939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:09.518458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:09.599665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd12d46-5f55-4223-b659-5ee251a546d3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:09.604645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:09.605558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:09.605846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:09.606130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] PATH_INFO: `/v3/users/e8039e6bfde34584a442cbc12a02129b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:09.607653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8039e6bfde34584a442cbc12a02129b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:09.609917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:09.672333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8039e6bfde34584a442cbc12a02129b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:09.673024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8039e6bfde34584a442cbc12a02129b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:09.680384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8039e6bfde34584a442cbc12a02129b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:09.681110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8039e6bfde34584a442cbc12a02129b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:09.690187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8039e6bfde34584a442cbc12a02129b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:09.711500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1072/2140] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:09 2022] DELETE /identity/v3/users/e8039e6bfde34584a442cbc12a02129b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:09.716288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:09.716818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:09.717007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:09.735293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:09.736513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:09.798392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1069/2141] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:09.808114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:09.809554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:09.871593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c65e9-ee3f-4515-84bf-3bad6cded5e6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:09.875416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:09.876080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:09.876372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:09.876655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:09.887363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:09.888959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:09.899732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1073/2142] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:09.995396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:09.997127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:10.111181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f302b55-28a2-4006-8075-d78943039fd7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:10.115020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:10.116093 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:10.116541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:10.116900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:10.119071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:10.201465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:10.202859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cba698-dec4-404e-8f63-2f283cdd72d6 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:10.213901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1070/2143] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:10.221552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:10.223265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:10.254612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6a07c-0ad5-49ce-b69c-24ede471c306 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:10.271835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:10.273015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:10.273307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:10.273588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] PATH_INFO: `/v3/projects/7ea454dd40064a02afef0dcc50652fa7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:10.274885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea454dd40064a02afef0dcc50652fa7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:10.276895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:10.304001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:10.368922 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea454dd40064a02afef0dcc50652fa7', 'request_id': 'req-c521f6c0-2b19-4997-a4e5-df651e554f72'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:10.382985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea454dd40064a02afef0dcc50652fa7', 'request_id': 'req-c521f6c0-2b19-4997-a4e5-df651e554f72'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:10.395739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea454dd40064a02afef0dcc50652fa7', 'request_id': 'req-c521f6c0-2b19-4997-a4e5-df651e554f72'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:10.414414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] The token cache is being invalidate because project 7ea454dd40064a02afef0dcc50652fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:10.414840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:10.415788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:10.432206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1074/2144] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:10 2022] DELETE /identity/v3/projects/7ea454dd40064a02afef0dcc50652fa7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:18.564175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6c6a-c6f7-4fdc-b5f8-d0a5ed078a47 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:18.565007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6c6a-c6f7-4fdc-b5f8-d0a5ed078a47 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:18.565165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6c6a-c6f7-4fdc-b5f8-d0a5ed078a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:18.593654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-178b6c6a-c6f7-4fdc-b5f8-d0a5ed078a47 None None] MFA Rules not processed for user `e29a5217495c41dda9564db96f6e36d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:18.595391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-178b6c6a-c6f7-4fdc-b5f8-d0a5ed078a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:18.625976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:18.660234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1071/2145] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:19.532704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:19.534502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:19.635901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f6c0-2b19-4997-a4e5-df651e554f72 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:19.642122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:19.643279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:19.643592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:19.643882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] PATH_INFO: `/v3/users/91083c1ab27f463685e95c5acb865673` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:19.645389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91083c1ab27f463685e95c5acb865673)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:19.648014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:19.709273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91083c1ab27f463685e95c5acb865673'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:19.710152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91083c1ab27f463685e95c5acb865673'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:19.723306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91083c1ab27f463685e95c5acb865673'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:19.724068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91083c1ab27f463685e95c5acb865673'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:19.732551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91083c1ab27f463685e95c5acb865673'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:19.755585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1075/2146] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:19 2022] DELETE /identity/v3/users/91083c1ab27f463685e95c5acb865673 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:19.760381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:19.761039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:19.761039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:19.780939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:19.782803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:19.848535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1072/2147] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:19.858907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:19.860823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:19.892398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:19.927033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e17d7-504e-4610-8c21-e9114a369b85 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:19.930847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5458c4-f4f6-487e-8e83-507ef9be230d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:19.931559 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5458c4-f4f6-487e-8e83-507ef9be230d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:19.931845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5458c4-f4f6-487e-8e83-507ef9be230d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:19.932125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5458c4-f4f6-487e-8e83-507ef9be230d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:19.943513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5458c4-f4f6-487e-8e83-507ef9be230d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:19.944965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5458c4-f4f6-487e-8e83-507ef9be230d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:19.958681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1076/2148] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:20.229153 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.230848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.244802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091648f4-d611-40f4-9d34-a1e255cf80b5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.251544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.252567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.252910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.253260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] PATH_INFO: `/v3/projects/745158bf86bc45898da2b6cda424ba0d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.254581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=745158bf86bc45898da2b6cda424ba0d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.257017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.314948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745158bf86bc45898da2b6cda424ba0d', 'request_id': 'req-adb66f7c-7a43-4117-aeb8-8ce070a06850'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.329051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745158bf86bc45898da2b6cda424ba0d', 'request_id': 'req-adb66f7c-7a43-4117-aeb8-8ce070a06850'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.338317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745158bf86bc45898da2b6cda424ba0d', 'request_id': 'req-adb66f7c-7a43-4117-aeb8-8ce070a06850'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.363624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] The token cache is being invalidate because project 745158bf86bc45898da2b6cda424ba0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:20.364417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.364708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-adb66f7c-7a43-4117-aeb8-8ce070a06850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.366337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1073/2149] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:20 2022] DELETE /identity/v3/projects/745158bf86bc45898da2b6cda424ba0d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:20.371365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.371732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.372544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.392080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:20.393335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.491138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1077/2150] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:20.494230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.496426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.496426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.525746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:20.526979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.538368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1074/2151] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:20.542442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.550955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.552413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.554497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3a0ab-ecb2-43b8-a805-0bca7694672b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.560583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.561354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.561647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.561929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.563505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:11:20.563829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.566121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef968f-006f-48b6-b4d1-83c48c64cfc2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.566259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.571791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.572400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.572694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.572975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] PATH_INFO: `/v3/users/75b5d89e883042f1a8856ae8ca575a12` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.574217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b5d89e883042f1a8856ae8ca575a12)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.576887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.583126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1078/2152] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:11:20.585880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.597185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee11961-fee2-4449-997e-98a6692834ec admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.603974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.605131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.605623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.606471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.607972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.610298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.646352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b5d89e883042f1a8856ae8ca575a12'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.652018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1079/2153] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:11:20 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:11:20.652205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:20.653278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.660705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b5d89e883042f1a8856ae8ca575a12'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.663533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b5d89e883042f1a8856ae8ca575a12'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.680045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b5d89e883042f1a8856ae8ca575a12'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.681320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-785d9840-072b-48ae-b802-c44ae6ae11cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b5d89e883042f1a8856ae8ca575a12'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.701948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1075/2154] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:20 2022] DELETE /identity/v3/users/75b5d89e883042f1a8856ae8ca575a12 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:20.705685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.706050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.706405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.733560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:20.735690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.750053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428449be-cd6e-4c31-ae31-510759aaaece admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.803905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:20.836549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.838043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.838403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.838760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.839900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.843746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.852004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1076/2155] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:20.853386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.855280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.881227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1080/2156] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:11:20 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:11:20.883152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.885614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.900022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0242c4-b96a-4340-a715-bde183807c9c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.905683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.906674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.906961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.907282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] PATH_INFO: `/v3/users/d07723de62484a618bc76358c16c302b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.908555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07723de62484a618bc76358c16c302b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.910513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.936637 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a1ca7-b7a0-4f44-896a-93ab10a1729d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.941041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.941814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.942203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.942581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.953932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.955423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:20.966122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1077/2157] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:20.967265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:20.968672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:20.970717 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07723de62484a618bc76358c16c302b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.971546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07723de62484a618bc76358c16c302b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.980513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07723de62484a618bc76358c16c302b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.981885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07723de62484a618bc76358c16c302b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.983262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f3054-6e66-4ee4-97bd-b044cb76cedf service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:20.989124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:20.989942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:20.990319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:20.990666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:20.991515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:20.992640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bee539e5-4c64-45cc-8da3-d971ebdd00fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07723de62484a618bc76358c16c302b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:20.993502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.008645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1078/2158] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:21.013086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.015870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.029860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1081/2159] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:20 2022] DELETE /identity/v3/users/d07723de62484a618bc76358c16c302b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:21.035915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.038037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e784d-7ad3-495e-a01e-241336546920 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.038369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.038809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.069085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:21.070789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.112625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:21.124656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.125550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.126039 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.126713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.128346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.131363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.157447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1079/2160] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:11:21.159345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.170973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae612-6f34-4e55-a8b3-4390c29b996d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.176881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427535c8-b94d-4045-b015-d1cf2549de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.178064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427535c8-b94d-4045-b015-d1cf2549de45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.178354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427535c8-b94d-4045-b015-d1cf2549de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.178640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427535c8-b94d-4045-b015-d1cf2549de45 admin admin] PATH_INFO: `/v3/projects/5e94b56039d24c41a18877cb9d9cfcd9/users/7dc44df3998641eeb6d3d5dbb7ff9b5d/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.194704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1082/2161] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:21.201301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427535c8-b94d-4045-b015-d1cf2549de45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e94b56039d24c41a18877cb9d9cfcd9, user_id=7dc44df3998641eeb6d3d5dbb7ff9b5d, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.204608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427535c8-b94d-4045-b015-d1cf2549de45 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.204873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.206325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.243141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1080/2162] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:21 2022] PUT /identity/v3/projects/5e94b56039d24c41a18877cb9d9cfcd9/users/7dc44df3998641eeb6d3d5dbb7ff9b5d/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:21.248040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.248524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.248817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.293220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] MFA Rules not processed for user `7dc44df3998641eeb6d3d5dbb7ff9b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:21.294678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.299813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:21.323349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86019b-6b17-4eaa-9405-f6a2843f3228 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.410706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1081/2163] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:21.411627 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.412975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.437314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.438008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.438881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.439785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.496618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d51b1-ad0a-424b-8211-98b23cfd324e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.503964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.505134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.505365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.505745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] PATH_INFO: `/v3/projects/3e7a6a9e32f94453a1502cc9972ec5d5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.507108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7a6a9e32f94453a1502cc9972ec5d5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.509384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.541981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.545012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.558235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1083/2164] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:11:21.559140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.560588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.595693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7a6a9e32f94453a1502cc9972ec5d5', 'request_id': 'req-397ab7dc-3cc5-47ff-8858-d48acd6291eb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.603169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7a6a9e32f94453a1502cc9972ec5d5', 'request_id': 'req-397ab7dc-3cc5-47ff-8858-d48acd6291eb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.609120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:21.610633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7a6a9e32f94453a1502cc9972ec5d5', 'request_id': 'req-397ab7dc-3cc5-47ff-8858-d48acd6291eb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.630290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] The token cache is being invalidate because project 3e7a6a9e32f94453a1502cc9972ec5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:21.630949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.631792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.634736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1082/2165] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:21 2022] DELETE /identity/v3/projects/3e7a6a9e32f94453a1502cc9972ec5d5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:21.640133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2418962-77a6-40e9-bd77-757663a6201b service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.640435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.642942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.730800 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.732163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.732470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.732736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.735265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.742732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab7dc-3cc5-47ff-8858-d48acd6291eb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.753457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.754804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.755339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.756392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] PATH_INFO: `/v3/users/d726b83d1038499694047aef1d4afe5b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.758526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:21.759380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d726b83d1038499694047aef1d4afe5b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.761945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.828160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.829813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.844343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1084/2166] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:21.853489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd726b83d1038499694047aef1d4afe5b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.868944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd726b83d1038499694047aef1d4afe5b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.870573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd726b83d1038499694047aef1d4afe5b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.876060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:21.877609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:21.889045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd726b83d1038499694047aef1d4afe5b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.890818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cde97130-9350-4d71-baae-c3ac4f0a08cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd726b83d1038499694047aef1d4afe5b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.895988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad330-ed70-4e85-a45d-c6cecdc518fa service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:21.904565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:21.905541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:21.905832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:21.906284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] PATH_INFO: `/v3/users/7dc44df3998641eeb6d3d5dbb7ff9b5d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:21.907663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc44df3998641eeb6d3d5dbb7ff9b5d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:21.910196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:21.911351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1083/2167] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:21 2022] DELETE /identity/v3/users/d726b83d1038499694047aef1d4afe5b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:21.977313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc44df3998641eeb6d3d5dbb7ff9b5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.978541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc44df3998641eeb6d3d5dbb7ff9b5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.992647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc44df3998641eeb6d3d5dbb7ff9b5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:21.993571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc44df3998641eeb6d3d5dbb7ff9b5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.007872 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc44df3998641eeb6d3d5dbb7ff9b5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.051680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1085/2168] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:21 2022] DELETE /identity/v3/users/7dc44df3998641eeb6d3d5dbb7ff9b5d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:22.055696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.056320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.056785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.082484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:22.084200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.099476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.101296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.226132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528feb7-e384-4110-a800-663905251ea8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.236543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.238076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.238642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.239267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] PATH_INFO: `/v3/projects/a53b1a2557ab4218be7bd1fe10954cf1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.241518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53b1a2557ab4218be7bd1fe10954cf1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.245774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.336237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1084/2169] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:22.356032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:22.374417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.376107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.393204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:22.393665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53b1a2557ab4218be7bd1fe10954cf1', 'request_id': 'req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.421951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53b1a2557ab4218be7bd1fe10954cf1', 'request_id': 'req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.445068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53b1a2557ab4218be7bd1fe10954cf1', 'request_id': 'req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.478719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] The token cache is being invalidate because project a53b1a2557ab4218be7bd1fe10954cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:22.479149 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.481070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.489101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1086/2170] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:22 2022] DELETE /identity/v3/projects/a53b1a2557ab4218be7bd1fe10954cf1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:22.489101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.489456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.530366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd72e8-4193-4645-b808-299c15ea1cd6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.589014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf50b8-fd0f-41bb-92ed-bbd81767033a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.593864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.596531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.596880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.597168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.599217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.600762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.602018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.602385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.602845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] PATH_INFO: `/v3/projects/12b4a6da86b94cb49a70e4048fae44b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.604880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b4a6da86b94cb49a70e4048fae44b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.607536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.615050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.616660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aef77-cb8f-40d3-a365-df2bb2ee9c04 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.629868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1085/2171] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:11:22.631425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b941ee-f4e9-4e8c-8ab0-23487bd9f208 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.631986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b941ee-f4e9-4e8c-8ab0-23487bd9f208 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.632366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b941ee-f4e9-4e8c-8ab0-23487bd9f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.655917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b9b941ee-f4e9-4e8c-8ab0-23487bd9f208 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:22.657284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b9b941ee-f4e9-4e8c-8ab0-23487bd9f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.682075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b4a6da86b94cb49a70e4048fae44b2', 'request_id': 'req-619aae74-5745-4260-8d3a-7c192cd9acd8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.692719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b4a6da86b94cb49a70e4048fae44b2', 'request_id': 'req-619aae74-5745-4260-8d3a-7c192cd9acd8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.702723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b4a6da86b94cb49a70e4048fae44b2', 'request_id': 'req-619aae74-5745-4260-8d3a-7c192cd9acd8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.720855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] The token cache is being invalidate because project 12b4a6da86b94cb49a70e4048fae44b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:22.721399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.722336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-619aae74-5745-4260-8d3a-7c192cd9acd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:22.724241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1087/2172] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:22 2022] DELETE /identity/v3/projects/12b4a6da86b94cb49a70e4048fae44b2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:22.730045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507546-ab34-44bd-bd27-d61a663773f4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.730334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507546-ab34-44bd-bd27-d61a663773f4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.730614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507546-ab34-44bd-bd27-d61a663773f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.745087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1086/2173] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:22.746630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.747028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.747856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.755197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f8507546-ab34-44bd-bd27-d61a663773f4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:22.756337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f8507546-ab34-44bd-bd27-d61a663773f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.768256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1088/2174] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:22.774136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:22.775691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.777628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.777929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.778741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.786054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1087/2175] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:22.790193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.801154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ddf30-9ace-458a-851d-795e9fe94513 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.801954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:22.803315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:22.807012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.807803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.808208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.808591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.809927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:11:22.810273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.812092 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.816265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1089/2176] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:22.817367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.828455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0676-4e04-4649-b9db-456677338d48 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.834771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1088/2177] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:11:22.835878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.836240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.837167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.837691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.838159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.839587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:11:22.840430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.842847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.850425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f956663-3963-482d-89f4-0a2810c791dd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.861062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.861757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.862800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.863249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.864140 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.866530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.867719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1090/2178] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:11:22.869302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.885524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feed47-8563-43ff-adc3-03c7399bbf3c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:22.892950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:22.893992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:22.894277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:22.894618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:22.895393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:22.898091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:22.910350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1089/2179] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:11:22.911271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.947294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1091/2180] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:11:22.950779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:22.958984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:22.962607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:23.018780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd508b-6db5-42de-bbd3-3dee723a77b1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.072087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5df5e-9467-4223-b235-559cd9b41b81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.078121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.078583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.078876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.079307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.080035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.082007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.100147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.101566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.102194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.102526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.103351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.105811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1092/2181] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:11:23.106058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.110263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.121320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87fb3e-bf7c-438e-8a27-878599fc15f5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.130665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.131415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.131701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.131982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.133448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.135173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.142464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1090/2182] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:11:22 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:11:23.146376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.150188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1093/2183] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:11:23.154083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.159024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e625e-4ee5-4785-b157-487383fd814f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.164391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.165178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.165553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.166114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.167358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.168686 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.169861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566ae85-6ef2-46f9-a5fe-f480a352ea02 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.176471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.178097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.178632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.179112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.179937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.181621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.185989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1091/2184] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:23.187519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.194700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1094/2185] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:11:23.198889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.201888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cb795-438d-4028-8f00-18609e04f445 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.208940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.209380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d705-77f3-4cab-abb9-b605c509281b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.209651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.209945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.210229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.210983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.212695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.214876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cd808-9bb5-41f2-89ae-97fb496a42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.215304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd808-9bb5-41f2-89ae-97fb496a42fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.215569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd808-9bb5-41f2-89ae-97fb496a42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.216304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd808-9bb5-41f2-89ae-97fb496a42fb admin admin] PATH_INFO: `/v3/projects/27f0dbe3244f431998c307b4c41bc0d3/users/06c66a59a1fa4012905e337786c4735d/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.232397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1092/2186] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:23.233496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.241361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cd808-9bb5-41f2-89ae-97fb496a42fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f0dbe3244f431998c307b4c41bc0d3, user_id=06c66a59a1fa4012905e337786c4735d, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.245045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cd808-9bb5-41f2-89ae-97fb496a42fb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.245269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21f635-83e0-4bc4-97ce-8440e9d2707b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.253085 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.253808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.254125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.254489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] PATH_INFO: `/v3/projects/070367cab3334be48e0644598d755492/users/c861e4c9be0b4e7ab86df8ec362013f1/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.267144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1095/2187] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:23 2022] PUT /identity/v3/projects/27f0dbe3244f431998c307b4c41bc0d3/users/06c66a59a1fa4012905e337786c4735d/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:23.273982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070367cab3334be48e0644598d755492, user_id=c861e4c9be0b4e7ab86df8ec362013f1, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.276907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.278394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28cd7-a2db-48b2-89a1-fef629d26090 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.278813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28cd7-a2db-48b2-89a1-fef629d26090 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.279365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28cd7-a2db-48b2-89a1-fef629d26090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.294899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1093/2188] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:23 2022] PUT /identity/v3/projects/070367cab3334be48e0644598d755492/users/c861e4c9be0b4e7ab86df8ec362013f1/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:23.298710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.304017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.316498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7fc28cd7-a2db-48b2-89a1-fef629d26090 None None] MFA Rules not processed for user `06c66a59a1fa4012905e337786c4735d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:23.317735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7fc28cd7-a2db-48b2-89a1-fef629d26090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.384198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a24b-c9ec-48ef-9776-4db0ac811466 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.390090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.391036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.391422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.391704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] PATH_INFO: `/v3/projects/5e94b56039d24c41a18877cb9d9cfcd9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.393667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1096/2189] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:23.393875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e94b56039d24c41a18877cb9d9cfcd9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.394144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.394441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.394765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.394975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.416930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:23.418186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.424381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:23.427195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1097/2190] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:23.431875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.433208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.465810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e94b56039d24c41a18877cb9d9cfcd9', 'request_id': 'req-e46549ca-7f3c-430a-9a44-c01b4934a4a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.473754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e94b56039d24c41a18877cb9d9cfcd9', 'request_id': 'req-e46549ca-7f3c-430a-9a44-c01b4934a4a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.477709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:23.480511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e94b56039d24c41a18877cb9d9cfcd9', 'request_id': 'req-e46549ca-7f3c-430a-9a44-c01b4934a4a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.500282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] The token cache is being invalidate because project 5e94b56039d24c41a18877cb9d9cfcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:23.500769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.506574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.508517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1094/2191] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:23 2022] DELETE /identity/v3/projects/5e94b56039d24c41a18877cb9d9cfcd9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:23.509444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.510853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.520196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b897520-46c2-46cb-ab96-f4b1d0f4b30e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.580340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.581324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.581787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.582066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.584864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.589772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46549ca-7f3c-430a-9a44-c01b4934a4a1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.594535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.595249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.595530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.595816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.597749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.668936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.670564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f49a8-0e47-48e5-accb-dca3a7ec1d27 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.675552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.677170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.681042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1098/2192] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:23.682468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c254-5e57-43d7-97e6-590a96482fdc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.682765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c254-5e57-43d7-97e6-590a96482fdc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.683049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c254-5e57-43d7-97e6-590a96482fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.689232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1095/2193] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:23.709272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.711883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.719297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7588c254-5e57-43d7-97e6-590a96482fdc None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:23.722533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7588c254-5e57-43d7-97e6-590a96482fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.739660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02717-2e67-4fb2-b5e8-68d3a69d5dcd service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.744490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1099/2194] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:23.746050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.748315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.748825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.749208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] PATH_INFO: `/v3/users/06c66a59a1fa4012905e337786c4735d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.750815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c66a59a1fa4012905e337786c4735d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.753109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.757132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.758273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.758273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.795493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:23.797008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.809385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1100/2195] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:23.820196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.838291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706685a-66b3-4c59-b727-b65465762e79 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.847646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.848997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.849254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.849739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.851133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:11:23.851703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.856092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.859423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c66a59a1fa4012905e337786c4735d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.870062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:23.879073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c66a59a1fa4012905e337786c4735d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.881242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c66a59a1fa4012905e337786c4735d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.883137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1101/2196] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:11:23.886855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.901374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505b28-76bb-4a50-bffd-8b61cfdd9461 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:23.906845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c66a59a1fa4012905e337786c4735d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.908360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5d6b1798-cfd1-42f5-b66a-97fe31f75e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c66a59a1fa4012905e337786c4735d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:23.910764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:23.913407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.915134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.916057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.918765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:23.926408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:23.933379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1096/2197] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:23 2022] DELETE /identity/v3/users/06c66a59a1fa4012905e337786c4735d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:23.938740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:23.939070 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:23.939331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:23.965707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:23.969978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:23.977195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1102/2198] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/projects => generated 389 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:11:23.980402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:23.983509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:24.102879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1097/2199] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:24.107204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:24.118416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:24.120095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:24.128083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251706f-874e-42cc-8471-ce1f5cfafae6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:24.133640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:24.134345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.134632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.134916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.135733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:24.138243 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:24.165939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1103/2200] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:11:23 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:11:24.171818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:24.187236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e608-f650-4df9-a075-356d594f2f43 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:24.195455 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:24.196903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.197458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.198006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.198752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32a2f-d392-4206-9305-00c33d3ad002 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:24.199547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:24.203325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:24.226025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1104/2201] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:24.232252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:24.256319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97507e-7b6c-430c-b35f-323909f5bd75 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:24.267779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:24.269063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.269690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.270265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.271802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:24.275529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:24.290536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140e73d-ab43-4c86-b0aa-76ae118ab074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:24.292467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e73d-ab43-4c86-b0aa-76ae118ab074 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.292771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e73d-ab43-4c86-b0aa-76ae118ab074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.293062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e73d-ab43-4c86-b0aa-76ae118ab074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.309279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140e73d-ab43-4c86-b0aa-76ae118ab074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:24.310502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1105/2202] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:11:24.311390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140e73d-ab43-4c86-b0aa-76ae118ab074 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:24.312350 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:24.332172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951814be-7b6b-4c4c-b1ca-9db0bdc6e739 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:24.338248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1098/2203] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:24.345914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:24.347274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.347722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.348172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] PATH_INFO: `/v3/projects/b5ca4b5c7c9043edb991f48408d9807e/users/eded15c9727f410ab7abd7d5c1d9931e/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.377444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ca4b5c7c9043edb991f48408d9807e, user_id=eded15c9727f410ab7abd7d5c1d9931e, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:24.383237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:24.413545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1106/2204] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:24 2022] PUT /identity/v3/projects/b5ca4b5c7c9043edb991f48408d9807e/users/eded15c9727f410ab7abd7d5c1d9931e/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:24.428212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c740f-a869-4422-a651-3db99723f13c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.428691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c740f-a869-4422-a651-3db99723f13c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.429339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c740f-a869-4422-a651-3db99723f13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.470056 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-432c740f-a869-4422-a651-3db99723f13c None None] MFA Rules not processed for user `eded15c9727f410ab7abd7d5c1d9931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:24.472257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-432c740f-a869-4422-a651-3db99723f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:24.498885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:24.567649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1099/2205] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:24.578086 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:24.580487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:24.664390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c967e-8983-429c-acdc-5d18cfc2a178 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:24.668589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c0df9-3a21-4897-bc62-b8e033c062c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:24.669554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c0df9-3a21-4897-bc62-b8e033c062c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:24.670502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c0df9-3a21-4897-bc62-b8e033c062c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:24.670502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c0df9-3a21-4897-bc62-b8e033c062c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:24.679979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c0df9-3a21-4897-bc62-b8e033c062c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:24.681513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c0df9-3a21-4897-bc62-b8e033c062c3 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:24.692524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1107/2206] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:25.359266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c740f-a869-4422-a651-3db99723f13c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:25.362147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-432c740f-a869-4422-a651-3db99723f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:25.486355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c740f-a869-4422-a651-3db99723f13c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:25.493493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:25.494618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:25.495080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:25.495503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] PATH_INFO: `/v3/projects/27f0dbe3244f431998c307b4c41bc0d3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:25.498620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f0dbe3244f431998c307b4c41bc0d3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:25.501926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:25.627218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f0dbe3244f431998c307b4c41bc0d3', 'request_id': 'req-432135bb-9c96-4e4e-b548-c846550c3edc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:25.644038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f0dbe3244f431998c307b4c41bc0d3', 'request_id': 'req-432135bb-9c96-4e4e-b548-c846550c3edc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:25.659747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f0dbe3244f431998c307b4c41bc0d3', 'request_id': 'req-432135bb-9c96-4e4e-b548-c846550c3edc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:25.696324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] The token cache is being invalidate because project 27f0dbe3244f431998c307b4c41bc0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:25.696892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:25.697839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-432135bb-9c96-4e4e-b548-c846550c3edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:25.704785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1100/2207] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:25 2022] DELETE /identity/v3/projects/27f0dbe3244f431998c307b4c41bc0d3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:25.706523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:25.707046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:25.707295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:25.731232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:25.732844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:25.845487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1108/2208] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:25.854470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:25.855058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:25.856968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:25.893814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:25.895253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:25.909016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:25.909585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1101/2209] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:25.920429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a731d3-77df-427f-af45-e521f60367ba None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:25.927465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:25.928571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:25.928571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:25.928921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:25.929532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:11:25.931226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:25.933430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:25.954103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1109/2210] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:11:25.958632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:25.970583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c8dc1-b31f-456e-92ed-1ab2e3fc0040 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:25.977116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:25.977940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:25.978236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:25.978526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:25.979373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:25.982007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:26.016270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1102/2211] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:11:25 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:11:26.021269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:26.039365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb701e3-e345-4779-8749-fabe87024d41 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:26.129431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:26.215185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:26.216291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:26.216661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:26.217376 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:26.218247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:26.220466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:26.246694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1110/2212] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:11:26 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:11:26.251324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:26.267945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4845a-7892-4dda-8ac7-15ef0df18d2b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:26.273650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:26.274335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:26.274620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:26.274896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:26.275684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:26.277618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:26.294108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1103/2213] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:26.299473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:26.311430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d53f-bd49-4c20-9900-0c42c2a21859 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:26.317992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d928e1d-281b-4fec-9ebe-93096e977e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:26.318773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928e1d-281b-4fec-9ebe-93096e977e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:26.319168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928e1d-281b-4fec-9ebe-93096e977e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:26.319525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928e1d-281b-4fec-9ebe-93096e977e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:26.320419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d928e1d-281b-4fec-9ebe-93096e977e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:26.322413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d928e1d-281b-4fec-9ebe-93096e977e72 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:26.342756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1111/2214] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:11:26.349730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:26.362902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad99807-2e38-4ec1-8481-ef1cdcd5b51f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:26.372928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:26.374158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:26.374462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:26.374750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] PATH_INFO: `/v3/projects/855b03621a104ac894f1406a2b1a4939/users/685ed2c0f28245ca8c621646a2cf72bf/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:26.380544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:26.397683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855b03621a104ac894f1406a2b1a4939, user_id=685ed2c0f28245ca8c621646a2cf72bf, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:26.401517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:26.416619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1104/2215] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:26 2022] PUT /identity/v3/projects/855b03621a104ac894f1406a2b1a4939/users/685ed2c0f28245ca8c621646a2cf72bf/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:26.430037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc346fb-710a-4534-a4a3-449ed2665b0d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:26.431214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc346fb-710a-4534-a4a3-449ed2665b0d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:26.431932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc346fb-710a-4534-a4a3-449ed2665b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:26.478526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8bc346fb-710a-4534-a4a3-449ed2665b0d None None] MFA Rules not processed for user `685ed2c0f28245ca8c621646a2cf72bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:26.482059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8bc346fb-710a-4534-a4a3-449ed2665b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:26.610208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1112/2216] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:26.621356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:26.623658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:26.699724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862f663-239c-4093-8a0b-177084bdcac7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:26.704996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:26.705791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:26.706830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:26.707218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:26.720735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:26.722354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:26.739296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1105/2217] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:29.615996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:29.616544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:29.616544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:29.647825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] MFA Rules not processed for user `c861e4c9be0b4e7ab86df8ec362013f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:29.649483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:29.753209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1113/2218] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:29.754762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:29.756424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:29.846126 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2a31-7045-4336-8c72-197f805a59c5 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:29.850839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:29.851715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:29.852082 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:29.852281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:29.853005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:29.854968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:29.888677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1106/2219] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:11:29 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:11:29.893032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:29.905361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508da0a-f2d1-4d25-a3ea-4d1a6767202b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:29.927673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:29.979421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:29.980138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:29.980427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:29.980707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:29.982049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:29.984264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:30.008945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1114/2220] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:11:29 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:11:30.013886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:30.025660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32b53-e06e-40c6-a149-b1cbf4138617 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:30.038729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:30.038729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:30.038729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:30.038729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:30.039200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:30.040939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:30.060009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1107/2221] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:30.064200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:30.075108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db7f4a-873d-4dd1-adc5-de87894f90e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:30.090046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:30.092134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:30.092588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:30.093051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] PATH_INFO: `/v3/projects/cd2d731872f346d689e9f7b2f276b634/users/5a436ea2ae9d4c568f2ecab274ed9b6b/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:30.115678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2d731872f346d689e9f7b2f276b634, user_id=5a436ea2ae9d4c568f2ecab274ed9b6b, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:30.119864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:30.136297 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1115/2222] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:30 2022] PUT /identity/v3/projects/cd2d731872f346d689e9f7b2f276b634/users/5a436ea2ae9d4c568f2ecab274ed9b6b/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:30.141073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:30.152184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dead5-d8ea-4d81-aa5e-0e774d29f544 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:30.213988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56d64e-c569-487f-9d5d-0225248f35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:30.214672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d64e-c569-487f-9d5d-0225248f35d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:30.214963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d64e-c569-487f-9d5d-0225248f35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:30.215307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d64e-c569-487f-9d5d-0225248f35d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:30.216630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56d64e-c569-487f-9d5d-0225248f35d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:30.218265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56d64e-c569-487f-9d5d-0225248f35d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:30.220542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:30.232776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1108/2223] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:11:30.236603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:30.248493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0936e-99a5-42a5-9d03-65a4d4beccb8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:30.254890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:30.255838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:30.256122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:30.256401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] PATH_INFO: `/v3/projects/cd2d731872f346d689e9f7b2f276b634/users/5a436ea2ae9d4c568f2ecab274ed9b6b/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:30.258493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2d731872f346d689e9f7b2f276b634, user_id=5a436ea2ae9d4c568f2ecab274ed9b6b, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:30.261662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:30.275868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1116/2224] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:11:30 2022] PUT /identity/v3/projects/cd2d731872f346d689e9f7b2f276b634/users/5a436ea2ae9d4c568f2ecab274ed9b6b/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:11:35.728541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9d229-25a7-4cd6-90e9-d8b99906dbbe None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:35.729065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9d229-25a7-4cd6-90e9-d8b99906dbbe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:35.729676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9d229-25a7-4cd6-90e9-d8b99906dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:35.776334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f5c9d229-25a7-4cd6-90e9-d8b99906dbbe None None] MFA Rules not processed for user `5a436ea2ae9d4c568f2ecab274ed9b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:35.782459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f5c9d229-25a7-4cd6-90e9-d8b99906dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:35.887158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1109/2225] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:35.897654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:35.899601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:36.025887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bebc9-b3f6-40d6-854b-779fd33e3739 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:36.032709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:36.033733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:36.034008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:36.034287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:36.088240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:36.106422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:36.108110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:36.118598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1117/2226] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:37.165991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:37.166797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:37.166797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:37.190656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] MFA Rules not processed for user `c861e4c9be0b4e7ab86df8ec362013f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:37.191849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:37.200429 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1110/2227] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:43.390387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:43.392211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:43.516493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049545-e2f9-4935-9a03-380117a45cef service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:43.522292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:43.522894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:43.523207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:43.523560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:43.525619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:43.540249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:43.543827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032540a-6c4a-4694-93aa-f689a3b6fc4d service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:43.560549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1118/2228] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:47.181165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=38 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:53.554688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=48 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:55.104956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:55.179384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0372-66f8-4cd8-8b74-3f9edeec866e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:55.184378 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:55.185320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:55.185610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:55.185893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] PATH_INFO: `/v3/users/685ed2c0f28245ca8c621646a2cf72bf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:55.187186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=685ed2c0f28245ca8c621646a2cf72bf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:55.189309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:55.246990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685ed2c0f28245ca8c621646a2cf72bf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:55.257764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685ed2c0f28245ca8c621646a2cf72bf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:55.258818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685ed2c0f28245ca8c621646a2cf72bf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:55.279452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685ed2c0f28245ca8c621646a2cf72bf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:55.284026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685ed2c0f28245ca8c621646a2cf72bf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:55.300163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1111/2229] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:55 2022] DELETE /identity/v3/users/685ed2c0f28245ca8c621646a2cf72bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:55.305870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:55.306948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:55.307510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:55.329764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:55.331033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:55.422754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1119/2230] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:11:55.434061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:55.435538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:55.502514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f999a-9084-458b-ac36-5fa5fa4dae9b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:55.506295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:55.506935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:55.507273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:55.507754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:55.519357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:55.520849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:55.532276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1112/2231] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:56.075747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:56.077525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:56.091834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49348d22-bc8b-4c5e-b770-5943e8aab69b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:56.097333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:56.098276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:56.099433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:56.099790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] PATH_INFO: `/v3/projects/855b03621a104ac894f1406a2b1a4939` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:56.101499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855b03621a104ac894f1406a2b1a4939)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:56.117216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:56.182190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855b03621a104ac894f1406a2b1a4939', 'request_id': 'req-2c730958-ea54-4d80-a470-5e985fc99c67'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:56.190387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855b03621a104ac894f1406a2b1a4939', 'request_id': 'req-2c730958-ea54-4d80-a470-5e985fc99c67'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:56.199030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855b03621a104ac894f1406a2b1a4939', 'request_id': 'req-2c730958-ea54-4d80-a470-5e985fc99c67'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:56.212960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] The token cache is being invalidate because project 855b03621a104ac894f1406a2b1a4939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:11:56.213263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:56.213981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2c730958-ea54-4d80-a470-5e985fc99c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:56.216421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1120/2232] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:56 2022] DELETE /identity/v3/projects/855b03621a104ac894f1406a2b1a4939 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:59.289805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:59.291282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:59.304585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a01b-2bf9-4ccb-a114-f0f726ed4b0e service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:59.328935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:59.373666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:59.374599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:59.374892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:59.375204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] PATH_INFO: `/v3/users/eded15c9727f410ab7abd7d5c1d9931e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:59.376453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eded15c9727f410ab7abd7d5c1d9931e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:59.378422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:59.428604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eded15c9727f410ab7abd7d5c1d9931e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:59.436801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eded15c9727f410ab7abd7d5c1d9931e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:59.437431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eded15c9727f410ab7abd7d5c1d9931e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:59.449842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eded15c9727f410ab7abd7d5c1d9931e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:59.450587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eded15c9727f410ab7abd7d5c1d9931e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:11:59.462811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1113/2233] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:11:59 2022] DELETE /identity/v3/users/eded15c9727f410ab7abd7d5c1d9931e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:11:59.467484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:59.467971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:59.468068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:59.486844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:11:59.488114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:59.551708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1121/2234] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:11:59.562178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:59.563633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:59.622295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df049-c05f-4111-ae49-ee00474438d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:59.626077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:59.626735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:59.627028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:59.627350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:59.636938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:59.638556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:59.648737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1114/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:11:59.920155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:11:59.921709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:11:59.936577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c253-aa59-4c2c-9971-c41b7fec3948 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:11:59.941443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:11:59.942988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:11:59.943486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:11:59.943762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] PATH_INFO: `/v3/projects/b5ca4b5c7c9043edb991f48408d9807e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:11:59.944998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ca4b5c7c9043edb991f48408d9807e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:11:59.947225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:11:59.970316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:00.001205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ca4b5c7c9043edb991f48408d9807e', 'request_id': 'req-7de99444-f42d-439d-ba02-5461bb34449e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:12:00.008905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ca4b5c7c9043edb991f48408d9807e', 'request_id': 'req-7de99444-f42d-439d-ba02-5461bb34449e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:12:00.016764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ca4b5c7c9043edb991f48408d9807e', 'request_id': 'req-7de99444-f42d-439d-ba02-5461bb34449e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:12:00.028821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] The token cache is being invalidate because project b5ca4b5c7c9043edb991f48408d9807e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:12:00.029111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:12:00.029789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7de99444-f42d-439d-ba02-5461bb34449e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:12:00.031391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1122/2236] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:11:59 2022] DELETE /identity/v3/projects/b5ca4b5c7c9043edb991f48408d9807e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:12:09.643958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=69,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:10.024343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:30.326446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:12:30.328027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:12:30.341205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6706ec-1806-4428-825e-dd518701ffba service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:12:30.408516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:12:30.409224 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:12:30.409515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:12:30.409806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:12:30.412007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:12:30.488180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:12:30.490250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb7a2-59e9-4da2-b120-0c9d77805ce7 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:12:30.505647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1115/2237] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:12:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:12:40.497401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=50 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:13.045723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:13.046153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:13.046301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:13.065437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] MFA Rules not processed for user `1421fb674ae04d6ea9ae342b73ce8115`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:13:13.066667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:13.125442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1123/2238] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:13:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:13:23.117672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:27.353563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:27.354123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:27.354123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:27.432013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:13:27.433272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:27.511210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1116/2239] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:13:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:13:27.557532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:27.558992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:27.661279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b47d-653e-4da9-9bea-217196d82121 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:27.667223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:27.667889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:27.668174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:27.668452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:27.680484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:27.682915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:27.692787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1124/2240] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:13:37.507143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=44 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:37.689131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=41 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:40.515899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:40.517425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:40.529807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5942af-5e70-4d09-83a9-9493c5530dbf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:40.533612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:40.534270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:40.534557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:40.534835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:40.536801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:40.620931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:40.622415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:40.634988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1117/2241] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:13:41.815238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:41.826085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816044a-e4be-4651-9dca-be595745e0d1 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:41.829752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:41.830387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:41.830671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:41.830949 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:41.832933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:41.851239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:41.854041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d11bee-3599-4252-ad40-8a4d7bfc5882 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:41.867483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1125/2242] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:13:43.669194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:43.678139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1eb2-6069-41bc-bc58-1df8e98173ca service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:43.682030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:43.682683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:43.682976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:43.683289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:43.685072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:43.695390 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:43.697403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03add9-85b2-4ce4-b6be-c40ffbf9de5b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:43.706103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1118/2243] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:13:43.814819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067d693-8a54-4faa-848d-fb0037f87fee None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:43.815762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067d693-8a54-4faa-848d-fb0037f87fee None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:43.816035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067d693-8a54-4faa-848d-fb0037f87fee None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:43.817707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1126/2244] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:13:43.824925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ab057-fbec-44ad-b30d-b564eb6f245c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:43.825314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ab057-fbec-44ad-b30d-b564eb6f245c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:43.825685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ab057-fbec-44ad-b30d-b564eb6f245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:43.872032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-304ab057-fbec-44ad-b30d-b564eb6f245c None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:13:43.874150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-304ab057-fbec-44ad-b30d-b564eb6f245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:43.889022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1119/2245] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:13:43.903805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067d693-8a54-4faa-848d-fb0037f87fee None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:43.906494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b067d693-8a54-4faa-848d-fb0037f87fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:44.002313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067d693-8a54-4faa-848d-fb0037f87fee None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:44.006428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256f612-b86d-49da-a1b4-da1563ee6d4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:44.007104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f612-b86d-49da-a1b4-da1563ee6d4e service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.007379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f612-b86d-49da-a1b4-da1563ee6d4e service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.007657 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256f612-b86d-49da-a1b4-da1563ee6d4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.019166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256f612-b86d-49da-a1b4-da1563ee6d4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:44.020879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256f612-b86d-49da-a1b4-da1563ee6d4e service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:44.033441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1127/2246] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:13:44.101939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366854-3fb4-4da9-9c0a-dc2b74fb4a5f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.103655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366854-3fb4-4da9-9c0a-dc2b74fb4a5f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.103655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366854-3fb4-4da9-9c0a-dc2b74fb4a5f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.104733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1120/2247] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:13:44.110032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508bcbe-efc4-4911-b563-0d61cd98951b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.110320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508bcbe-efc4-4911-b563-0d61cd98951b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.110602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508bcbe-efc4-4911-b563-0d61cd98951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.129707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c508bcbe-efc4-4911-b563-0d61cd98951b None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:13:44.130816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c508bcbe-efc4-4911-b563-0d61cd98951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:44.138169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1128/2248] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:13:44.151892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366854-3fb4-4da9-9c0a-dc2b74fb4a5f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:44.162992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366854-3fb4-4da9-9c0a-dc2b74fb4a5f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:44.167594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476b3ae-4dfe-437f-bf8c-27c12c647942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:44.168247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476b3ae-4dfe-437f-bf8c-27c12c647942 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.168537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476b3ae-4dfe-437f-bf8c-27c12c647942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.168823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476b3ae-4dfe-437f-bf8c-27c12c647942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.176520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476b3ae-4dfe-437f-bf8c-27c12c647942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:44.177988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476b3ae-4dfe-437f-bf8c-27c12c647942 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:44.186861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1121/2249] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:13:44.273277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453f934-97cf-4815-976f-9dbe67b52344 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.273572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453f934-97cf-4815-976f-9dbe67b52344 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.273854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453f934-97cf-4815-976f-9dbe67b52344 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.276022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1129/2250] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:13:44.281099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.281398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.281684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.299967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:13:44.301162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:44.311619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1122/2251] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:13:44.322638 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453f934-97cf-4815-976f-9dbe67b52344 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:44.324382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a453f934-97cf-4815-976f-9dbe67b52344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:44.339299 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453f934-97cf-4815-976f-9dbe67b52344 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:44.343168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf4e8b-1e6f-40e5-a51f-07307784a8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:44.343811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf4e8b-1e6f-40e5-a51f-07307784a8fc service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.344098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf4e8b-1e6f-40e5-a51f-07307784a8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.344378 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf4e8b-1e6f-40e5-a51f-07307784a8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.355590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf4e8b-1e6f-40e5-a51f-07307784a8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:44.357018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf4e8b-1e6f-40e5-a51f-07307784a8fc service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:44.368465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1130/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:13:44.533046 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:44.534444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:44.609221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003c72-7c53-4632-b46c-a7c94e25e5aa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:44.614235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:44.614885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:44.615198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:44.615484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:44.617375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:44.631144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:44.632918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:44.644436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1123/2253] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:13:47.031013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:47.031541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:47.031634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:47.050765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:13:47.052013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:13:47.059583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1131/2254] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:13:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:13:47.071751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:13:47.083264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27b2d-ae94-4a8d-8d7d-4342b06d076e service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:13:47.089645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:13:47.090300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:13:47.090582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:13:47.090857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:13:47.099307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:13:47.100900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:13:47.110185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1124/2255] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:13:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:13:57.045644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=53 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:57.106864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:00.611477 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:14:00.620902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f1444-afc4-46fb-a1a1-cc7a9580fcc3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:14:00.624525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:14:00.625169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:00.625457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:00.625738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:00.627700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:00.689025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:14:00.690459 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:14:00.700392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1132/2256] 10.222.0.45 () {60 vars in 1396 bytes} [Thu May 26 15:14:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:14:04.683660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:14:04.685193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:04.746188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0fd08-cee1-4334-9a64-7ef51e06914e service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:14:04.749909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:14:04.750572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:04.750892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:04.751211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:04.753194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:04.814503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:14:04.816024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68420b00-04e1-435e-a545-3e800819138d service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:14:04.827196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1125/2257] 10.222.0.45 () {60 vars in 1396 bytes} [Thu May 26 15:14:04 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:14:10.696220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:13.741594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:14:13.751222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd53f13-9469-4f4a-aecd-8f544fe36999 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:14:13.755021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:14:13.755735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:13.756023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:13.756314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:13.759479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:13.775060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:14:13.775060 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:14:13.784913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1133/2258] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:14:14.822690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=48 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:16.997131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ad839-1de0-46d0-88dc-586f2fd7093c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:16.997743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ad839-1de0-46d0-88dc-586f2fd7093c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:16.997743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ad839-1de0-46d0-88dc-586f2fd7093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:17.015795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cf5ad839-1de0-46d0-88dc-586f2fd7093c None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:14:17.017018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cf5ad839-1de0-46d0-88dc-586f2fd7093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:17.025711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1126/2259] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:14:17.040250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:14:17.052886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84d64-b0cd-41a2-8a7c-8db19d3d287d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:14:17.058684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:14:17.059371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:17.059659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:17.059936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:17.068565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:14:17.070202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:14:17.078463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1134/2260] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:14:27.010728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:27.075067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=12 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:34.416154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:34.416717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:34.416717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:34.435448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] MFA Rules not processed for user `e29a5217495c41dda9564db96f6e36d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:14:34.436698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:34.443750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1127/2261] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:14:40.645325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:14:40.646940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:40.664082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da11a-59b1-4953-bf53-a6eb8ddd7205 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:14:40.677788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:14:40.677788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:40.677788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:40.678214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:40.682008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:40.699458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:14:40.701228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:14:40.714747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1135/2262] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:14:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:14:44.430350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:44.881087 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:14:44.895376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417e0e5-4d50-4d4c-849a-342c1c0a4fe7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:14:44.902188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:14:44.902837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:14:44.903148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:14:44.903427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:14:44.905190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:14:44.968777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:14:44.970407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:14:44.980098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1128/2263] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:14:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:14:50.709226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:54.985302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=28 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:11.340919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:15:11.352397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257fc8b-3ca2-4a3d-9a38-daacb65450cb service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:15:11.357898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:15:11.358594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:15:11.358878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:15:11.359191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:15:11.366415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:15:11.377708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:15:11.379310 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223d284-5179-46b3-864f-67538ae045d7 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:15:11.388933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1136/2264] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:15:14.702728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:15:14.715823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220c8b-b880-4dea-982f-ba7eed6e60c2 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:15:14.722165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:15:14.723068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:15:14.723609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:15:14.724055 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:15:14.726814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:15:14.745480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:15:14.747149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:15:14.770301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1129/2265] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:15:21.384851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:24.515720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:15:24.516355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:15:24.516355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:15:24.540963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] MFA Rules not processed for user `1421fb674ae04d6ea9ae342b73ce8115`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:15:24.542360 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:15:24.549478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1137/2266] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:15:24.761780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:24.847286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:15:24.856652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7536f2b-0b09-451e-867c-810eba4e18c0 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:15:24.860236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:15:24.860873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:15:24.861160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:15:24.861437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:15:24.863238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:15:24.873609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:15:24.875041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849cb90-a667-43e6-82e8-6b858408ebcf service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:15:24.883957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1130/2267] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:15:34.530006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:34.879488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:35.134565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:15:35.153868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7849da6-9fb8-4656-8640-ee1861229541 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:15:35.161171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:15:35.162423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:15:35.162917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:15:35.163400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:15:35.165672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:15:35.180582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:15:35.182944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:15:35.199774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1138/2268] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:15:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:15:45.191716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:48.684861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:15:48.685515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:15:48.685515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:15:48.705143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] MFA Rules not processed for user `1748648695bb46a9b2c7912c48e95bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:15:48.706357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:15:48.714459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1131/2269] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:15:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:15:58.698368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:17.176867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:17.186403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74fe1-0997-4269-9764-476531ae9e29 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:17.190134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:17.190783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:17.191071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:17.192026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:17.193900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:17.258523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:17.260007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:17.271779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1139/2270] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:20.664999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:20.678601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54db3d-2ec9-4568-a569-e457370738d5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:20.684166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:20.684820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:20.685112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:20.685394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:20.687276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:20.702344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:20.704154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:20.715844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1132/2271] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:16:20.750577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:20.752577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:20.766783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981775-2048-41b2-af06-b089d00ad0d7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:20.773435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:20.774323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:20.774633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:20.774913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] PATH_INFO: `/v3/users/e29a5217495c41dda9564db96f6e36d1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:20.776162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29a5217495c41dda9564db96f6e36d1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:20.778137 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:20.831141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29a5217495c41dda9564db96f6e36d1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:20.831744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29a5217495c41dda9564db96f6e36d1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:20.839132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29a5217495c41dda9564db96f6e36d1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:20.839814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29a5217495c41dda9564db96f6e36d1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:20.850208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-da93d831-4713-48a8-a3ad-efee80f47761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29a5217495c41dda9564db96f6e36d1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:20.867600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1140/2272] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:20 2022] DELETE /identity/v3/users/e29a5217495c41dda9564db96f6e36d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:21.067371 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.081466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671df105-190b-4edc-9c7d-00e575a2613f service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.159658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.160674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.161125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.161466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] PATH_INFO: `/v3/projects/bf95995343d547f78ae88a425f584ac7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.162799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf95995343d547f78ae88a425f584ac7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.164881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.214612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf95995343d547f78ae88a425f584ac7', 'request_id': 'req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:21.221743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf95995343d547f78ae88a425f584ac7', 'request_id': 'req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:21.228749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf95995343d547f78ae88a425f584ac7', 'request_id': 'req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:21.243259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] The token cache is being invalidate because project bf95995343d547f78ae88a425f584ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:21.243549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:21.244243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eed2860e-c1fc-4af5-b4f2-2ae60578e57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:21.245810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1133/2273] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:21 2022] DELETE /identity/v3/projects/bf95995343d547f78ae88a425f584ac7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:21.250691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.251034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.251357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.272539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:21.274724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:21.341893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1141/2274] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:16:21.350352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be34a-5423-47c1-9424-b95276348343 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.350651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be34a-5423-47c1-9424-b95276348343 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.350984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be34a-5423-47c1-9424-b95276348343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.370801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-373be34a-5423-47c1-9424-b95276348343 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:21.372044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-373be34a-5423-47c1-9424-b95276348343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:21.387000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1134/2275] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:21.393576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.404168 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4fcf8-ed6a-47b0-903f-9b710cabd8c6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.409034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.409696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.410079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.410947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.411730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:16:21.412045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.413651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.415366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:21.429122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1142/2276] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:16:21.433292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be34a-5423-47c1-9424-b95276348343 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.444061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be34a-5423-47c1-9424-b95276348343 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.448919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.449583 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.449868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.450145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.450844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.452920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.493683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1135/2277] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:21.498251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.510629 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c6f9-115a-4c84-a244-ea4019a47a3e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.574077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.574761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.575057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.575364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.576109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.578057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.599616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1143/2278] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:21.603884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.615587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6015-3a2c-4bad-b156-77d9cb940f7c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.621450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.622134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.622424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.622708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.623476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.625113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.636031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1136/2279] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:21.640275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.651829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f618-5d0e-4221-a17d-203aabdefa8b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.656686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094272-b78a-41a3-a525-49c756031177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.657358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094272-b78a-41a3-a525-49c756031177 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.657647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094272-b78a-41a3-a525-49c756031177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.657928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094272-b78a-41a3-a525-49c756031177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.658663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94094272-b78a-41a3-a525-49c756031177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.661006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94094272-b78a-41a3-a525-49c756031177 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.672262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1144/2280] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:21.681541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.692863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68a93-de7b-40a3-9de9-458fc94245eb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.697732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.698626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.698917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.699235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] PATH_INFO: `/v3/projects/efb64797057f452e85a5c736fa55ef36/users/3142c56b65e7494dab891d93759b6b79/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.716115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb64797057f452e85a5c736fa55ef36, user_id=3142c56b65e7494dab891d93759b6b79, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.718816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.732163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1137/2281] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:21 2022] PUT /identity/v3/projects/efb64797057f452e85a5c736fa55ef36/users/3142c56b65e7494dab891d93759b6b79/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:21.743232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de876c7-dd97-421c-a877-bd843646587f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.743521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de876c7-dd97-421c-a877-bd843646587f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.743794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de876c7-dd97-421c-a877-bd843646587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.775101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6de876c7-dd97-421c-a877-bd843646587f None None] MFA Rules not processed for user `3142c56b65e7494dab891d93759b6b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:21.776343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6de876c7-dd97-421c-a877-bd843646587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:21.849953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1145/2282] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:21.854536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.861098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:21.922076 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c886c1-728d-43cd-8a94-ab11c0ae06e4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:21.927578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:21.928257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:21.928547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:21.928836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:21.929546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:21.931536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:21.961148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1138/2283] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:21.962274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de876c7-dd97-421c-a877-bd843646587f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:21.974130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de876c7-dd97-421c-a877-bd843646587f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.032994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.033682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.033975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.034262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.039969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.039969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.045990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:22.062929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1146/2284] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:21 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:22.068859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.080179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f69f-5dc0-477f-8a18-36f01ee2d918 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.087357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.088042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.088329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.088608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.089348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.090993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.103064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1139/2285] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:22.107413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.118851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926e2c-7306-49f4-8640-c6fc9e7f0e2b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.123690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.124587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.124871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.125147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] PATH_INFO: `/v3/projects/ab10d2347d3a401f8fe166437e61bac7/users/cfd57465c361450c8803ede50e6973d3/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.142309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab10d2347d3a401f8fe166437e61bac7, user_id=cfd57465c361450c8803ede50e6973d3, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.145545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.162444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1147/2286] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:22 2022] PUT /identity/v3/projects/ab10d2347d3a401f8fe166437e61bac7/users/cfd57465c361450c8803ede50e6973d3/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:22.168353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.179194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8578a-1e7c-412c-bd5a-9528005c43a9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.238535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f10f8-85a4-41b1-b338-7b00c0df51b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.239241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f10f8-85a4-41b1-b338-7b00c0df51b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.239534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f10f8-85a4-41b1-b338-7b00c0df51b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.239949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f10f8-85a4-41b1-b338-7b00c0df51b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.240698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f10f8-85a4-41b1-b338-7b00c0df51b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.242335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f10f8-85a4-41b1-b338-7b00c0df51b7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.253111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1140/2287] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:22.257893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.268909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d834-9711-4430-bf4e-8910609be18c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.274327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.275256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.275541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.275814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] PATH_INFO: `/v3/projects/ab10d2347d3a401f8fe166437e61bac7/users/cfd57465c361450c8803ede50e6973d3/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.277776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab10d2347d3a401f8fe166437e61bac7, user_id=cfd57465c361450c8803ede50e6973d3, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.280472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.292018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1148/2288] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:22 2022] PUT /identity/v3/projects/ab10d2347d3a401f8fe166437e61bac7/users/cfd57465c361450c8803ede50e6973d3/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:22.304914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.305203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.305484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.334756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] MFA Rules not processed for user `cfd57465c361450c8803ede50e6973d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:22.336023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:22.411751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:22.417342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1141/2289] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:22.429083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.430826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:22.495624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4ca8c-6a19-4f55-9e47-d9ab5de4c046 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.500314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a8e92-747e-46f5-9b22-ce1e9396c1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.501016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a8e92-747e-46f5-9b22-ce1e9396c1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.501373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a8e92-747e-46f5-9b22-ce1e9396c1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.501853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a8e92-747e-46f5-9b22-ce1e9396c1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.514489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a8e92-747e-46f5-9b22-ce1e9396c1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.515988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a8e92-747e-46f5-9b22-ce1e9396c1c0 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.526669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1149/2290] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:22.676733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.754582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0447e-5762-4a6b-8159-cc6eab653594 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:22.759481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:22.760438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.760804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.761649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] PATH_INFO: `/v3/users/3142c56b65e7494dab891d93759b6b79` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.762891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3142c56b65e7494dab891d93759b6b79)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:22.764905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:22.831125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3142c56b65e7494dab891d93759b6b79'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:22.840363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3142c56b65e7494dab891d93759b6b79'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:22.841479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3142c56b65e7494dab891d93759b6b79'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:22.854554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3142c56b65e7494dab891d93759b6b79'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:22.855278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3142c56b65e7494dab891d93759b6b79'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:22.868691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1142/2291] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:22 2022] DELETE /identity/v3/users/3142c56b65e7494dab891d93759b6b79 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:22.873308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:22.873794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:22.873891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:22.892912 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:22.894972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:22.955914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1150/2292] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:22.966443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:22.967903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:23.028490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa7aa4-92da-44eb-8883-53e6b0a9fae1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:23.033957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:23.034651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:23.035713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:23.035847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:23.046031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:23.047535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:23.058165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1143/2293] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:23.349219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:23.350715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:23.364598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6703a-a14f-4dc8-8f9d-10697f5402ed None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:23.369370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:23.370282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:23.370565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:23.370841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] PATH_INFO: `/v3/projects/efb64797057f452e85a5c736fa55ef36` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:23.372097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb64797057f452e85a5c736fa55ef36)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:23.374104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:23.425184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb64797057f452e85a5c736fa55ef36', 'request_id': 'req-a9c5445b-56df-4fb6-9aca-fc66507387a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.429136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:23.434856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb64797057f452e85a5c736fa55ef36', 'request_id': 'req-a9c5445b-56df-4fb6-9aca-fc66507387a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.444274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb64797057f452e85a5c736fa55ef36', 'request_id': 'req-a9c5445b-56df-4fb6-9aca-fc66507387a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.455669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] The token cache is being invalidate because project efb64797057f452e85a5c736fa55ef36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:23.455964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.456684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.458302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1151/2294] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:23 2022] DELETE /identity/v3/projects/efb64797057f452e85a5c736fa55ef36 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:23.462275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:23.473426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f79c1e-29cf-41ab-afff-65ae1fb35048 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:23.493408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:23.537325 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:23.538164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:23.538451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:23.538732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] PATH_INFO: `/v3/users/cfd57465c361450c8803ede50e6973d3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:23.540011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd57465c361450c8803ede50e6973d3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:23.541960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:23.592790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd57465c361450c8803ede50e6973d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.600659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd57465c361450c8803ede50e6973d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.601315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd57465c361450c8803ede50e6973d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.614027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd57465c361450c8803ede50e6973d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.614735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-13cbabe6-07f5-405d-9a2d-2ae463cfcd2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd57465c361450c8803ede50e6973d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:23.627790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1144/2295] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:23 2022] DELETE /identity/v3/users/cfd57465c361450c8803ede50e6973d3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:23.934803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:23.936267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:23.961473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5445b-56df-4fb6-9aca-fc66507387a0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.030448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.031830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.032113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.032413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] PATH_INFO: `/v3/projects/ab10d2347d3a401f8fe166437e61bac7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.034124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab10d2347d3a401f8fe166437e61bac7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.039522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.109944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab10d2347d3a401f8fe166437e61bac7', 'request_id': 'req-048f89e0-85c2-41f8-a338-c7110775cc5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:24.120028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab10d2347d3a401f8fe166437e61bac7', 'request_id': 'req-048f89e0-85c2-41f8-a338-c7110775cc5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:24.127440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab10d2347d3a401f8fe166437e61bac7', 'request_id': 'req-048f89e0-85c2-41f8-a338-c7110775cc5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:24.140156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] The token cache is being invalidate because project ab10d2347d3a401f8fe166437e61bac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:24.140451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:24.141123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-048f89e0-85c2-41f8-a338-c7110775cc5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:24.142732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1152/2296] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:23 2022] DELETE /identity/v3/projects/ab10d2347d3a401f8fe166437e61bac7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:24.148860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.149402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.149501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.168068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:24.169295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:24.233985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1145/2297] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:24.242529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.242823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.243130 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.272609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:24.273821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:24.281847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1153/2298] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:24.286527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.296754 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7afb-f6b4-45da-85a7-87f24ff02dbb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.302129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.302794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.303105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.303391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.304132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:16:24.304445 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.306074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.319195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1146/2299] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:16:24.323771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.334081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a6a5-3c73-4404-b3ae-69fceacf3d52 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.338822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.339553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.339849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.340133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.340845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.342769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.371337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1154/2300] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:24.376747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.387859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4b39-ce79-453a-9060-06b68e4793af admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.416120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:24.452400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.453083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.453374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.453656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.454369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.456363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.477836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1147/2301] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:24.481954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.493488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89f00-0d97-4067-88c5-73ecd149daa1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.498341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.498971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.499292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.499577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.500306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.501935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.513803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1155/2302] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:24.518042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.529468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f84577-2aff-4ee7-a938-b47d299c14d9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.534891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f069-7ca5-47a5-b274-bfef86c33da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.535624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f069-7ca5-47a5-b274-bfef86c33da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.535921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f069-7ca5-47a5-b274-bfef86c33da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.536202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f069-7ca5-47a5-b274-bfef86c33da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.536943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98f069-7ca5-47a5-b274-bfef86c33da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.538586 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98f069-7ca5-47a5-b274-bfef86c33da3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.550116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1148/2303] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:16:24.554911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.565265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690a415-016e-4a0d-8ee2-1faa75884e91 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.570868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.571795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.572085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.572363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] PATH_INFO: `/v3/projects/c5f6b622b54d478bbe49490f22b11614/users/95808f55ad12489796891980ba904c45/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.589498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f6b622b54d478bbe49490f22b11614, user_id=95808f55ad12489796891980ba904c45, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.592194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.607308 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1156/2304] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:24 2022] PUT /identity/v3/projects/c5f6b622b54d478bbe49490f22b11614/users/95808f55ad12489796891980ba904c45/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:24.618417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.619109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.619395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.650134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] MFA Rules not processed for user `95808f55ad12489796891980ba904c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:24.651681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:24.727470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1149/2305] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:24.732220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.743039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:24.809644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79895847-1537-44f3-9e67-35756940ad1a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.814728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.815454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.815737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.816036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.817018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.818995 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.857394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1157/2306] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:24.858535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.871047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0732-78d5-4b01-bca6-2ddee65a7e32 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.938889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.939623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.939913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.940191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.940932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:24.942918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:24.970830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1150/2307] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:24 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:16:24.972484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:24.984177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16999f5e-fcd2-4115-99a3-c28d64500d3c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:24.996083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:24.996861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:24.997231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:24.997592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:24.998659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:25.000434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:25.013701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1158/2308] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:25.017588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:25.034748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b307a-675a-4d2b-8101-884643292b2a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:25.047680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:25.048603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:25.048894 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:25.049177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] PATH_INFO: `/v3/projects/f9b775fb8ca44935aa8f5a5190a8df53/users/fd2b06b107e94453a8bc59eda35cc22e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:25.067437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b775fb8ca44935aa8f5a5190a8df53, user_id=fd2b06b107e94453a8bc59eda35cc22e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:25.070144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:25.084815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1151/2309] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:25 2022] PUT /identity/v3/projects/f9b775fb8ca44935aa8f5a5190a8df53/users/fd2b06b107e94453a8bc59eda35cc22e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:16:25.091522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:25.105534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0083-8b98-4a0c-9695-e741d6d60b87 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:25.187429 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1eb88-462c-4c86-9376-e580dfff1147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:25.188715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eb88-462c-4c86-9376-e580dfff1147 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:25.189100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eb88-462c-4c86-9376-e580dfff1147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:25.189474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eb88-462c-4c86-9376-e580dfff1147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:25.190318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1eb88-462c-4c86-9376-e580dfff1147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:25.192913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1eb88-462c-4c86-9376-e580dfff1147 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:25.206576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1159/2310] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:25.210964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:25.217542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:25.224031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e78a7-f48d-44b3-8870-8d414b6aee21 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:25.232044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:25.233654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:25.234065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:25.234455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] PATH_INFO: `/v3/projects/f9b775fb8ca44935aa8f5a5190a8df53/users/fd2b06b107e94453a8bc59eda35cc22e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:25.237069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b775fb8ca44935aa8f5a5190a8df53, user_id=fd2b06b107e94453a8bc59eda35cc22e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:25.240881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:25.254949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1152/2311] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:25 2022] PUT /identity/v3/projects/f9b775fb8ca44935aa8f5a5190a8df53/users/fd2b06b107e94453a8bc59eda35cc22e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:16:25.267277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:25.267579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:25.267893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:25.296685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] MFA Rules not processed for user `fd2b06b107e94453a8bc59eda35cc22e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:25.297821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:25.383334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1160/2312] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:25.391770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:25.393838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:25.466737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b412-9a9f-4ebd-8b8d-7560d5681925 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:25.470817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340613-e77f-4890-828c-77a42d1eb86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:25.471573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340613-e77f-4890-828c-77a42d1eb86f service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:25.471863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340613-e77f-4890-828c-77a42d1eb86f service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:25.472147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340613-e77f-4890-828c-77a42d1eb86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:25.482742 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55340613-e77f-4890-828c-77a42d1eb86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:25.484255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55340613-e77f-4890-828c-77a42d1eb86f service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:25.495930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1153/2313] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:26.008101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:26.013280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:26.086212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96e426-0c3b-4f7e-b695-3edb87405cc6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:26.091919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:26.093220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:26.094012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:26.094012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] PATH_INFO: `/v3/users/95808f55ad12489796891980ba904c45` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:26.096157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=95808f55ad12489796891980ba904c45)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:26.099554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:26.163462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95808f55ad12489796891980ba904c45'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.164142 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95808f55ad12489796891980ba904c45'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.171862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95808f55ad12489796891980ba904c45'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.172596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95808f55ad12489796891980ba904c45'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.185854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95808f55ad12489796891980ba904c45'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.214681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1161/2314] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:26 2022] DELETE /identity/v3/users/95808f55ad12489796891980ba904c45 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:16:26.220276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b112f-7167-49cb-936a-b568d5381635 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:26.220832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b112f-7167-49cb-936a-b568d5381635 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:26.220992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b112f-7167-49cb-936a-b568d5381635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:26.241984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-457b112f-7167-49cb-936a-b568d5381635 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:26.243366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-457b112f-7167-49cb-936a-b568d5381635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:26.321203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1154/2315] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:26.332454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:26.336120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:26.432309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327017-0169-4069-bcc6-133fc2cc19fe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:26.437047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:26.437701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:26.437984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:26.438261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:26.459291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:26.460589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:26.471652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1162/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:26.772408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b112f-7167-49cb-936a-b568d5381635 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:26.774012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-457b112f-7167-49cb-936a-b568d5381635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:26.790149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b112f-7167-49cb-936a-b568d5381635 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:26.797396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:26.798293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:26.798578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:26.798859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] PATH_INFO: `/v3/projects/c5f6b622b54d478bbe49490f22b11614` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:26.800106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f6b622b54d478bbe49490f22b11614)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:26.802780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:26.856753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f6b622b54d478bbe49490f22b11614', 'request_id': 'req-45a54d4b-a253-4d29-9886-0c9638e39ee9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.863650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f6b622b54d478bbe49490f22b11614', 'request_id': 'req-45a54d4b-a253-4d29-9886-0c9638e39ee9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.870570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f6b622b54d478bbe49490f22b11614', 'request_id': 'req-45a54d4b-a253-4d29-9886-0c9638e39ee9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.885428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] The token cache is being invalidate because project c5f6b622b54d478bbe49490f22b11614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:26.885864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.886750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:26.888756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1155/2317] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:26 2022] DELETE /identity/v3/projects/c5f6b622b54d478bbe49490f22b11614 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:26.894167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:26.904566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c52eb-4b66-4dbe-93fd-8bf41ef3c9fb service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:26.928143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:26.969197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:26.970177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:26.970483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:26.970825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] PATH_INFO: `/v3/users/fd2b06b107e94453a8bc59eda35cc22e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:26.972027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2b06b107e94453a8bc59eda35cc22e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:26.973966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:27.030320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2b06b107e94453a8bc59eda35cc22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.031210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2b06b107e94453a8bc59eda35cc22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.040503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2b06b107e94453a8bc59eda35cc22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.041286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2b06b107e94453a8bc59eda35cc22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.052334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-79de52d1-7ae7-494f-a22c-ffca05bdf462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2b06b107e94453a8bc59eda35cc22e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.070773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1163/2318] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:26 2022] DELETE /identity/v3/users/fd2b06b107e94453a8bc59eda35cc22e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:27.364594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:27.366093 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:27.384784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a54d4b-a253-4d29-9886-0c9638e39ee9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:27.399825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:27.456270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:27.457838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:27.458132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:27.458418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] PATH_INFO: `/v3/projects/f9b775fb8ca44935aa8f5a5190a8df53` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:27.459714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b775fb8ca44935aa8f5a5190a8df53)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:27.463698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:27.530259 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b775fb8ca44935aa8f5a5190a8df53', 'request_id': 'req-39ac1074-2956-4cb5-8941-847f5e5d7b11'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.540149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b775fb8ca44935aa8f5a5190a8df53', 'request_id': 'req-39ac1074-2956-4cb5-8941-847f5e5d7b11'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.546738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b775fb8ca44935aa8f5a5190a8df53', 'request_id': 'req-39ac1074-2956-4cb5-8941-847f5e5d7b11'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.562738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] The token cache is being invalidate because project f9b775fb8ca44935aa8f5a5190a8df53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:27.562738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.562738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39ac1074-2956-4cb5-8941-847f5e5d7b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:27.563565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1156/2319] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:27 2022] DELETE /identity/v3/projects/f9b775fb8ca44935aa8f5a5190a8df53 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:27.569382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:27.569708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:27.569994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:27.591567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:27.592838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:27.722003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1164/2320] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:27.731540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:27.731906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:27.732249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:27.756137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:27.757389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:27.766497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1157/2321] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:27.771753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:27.781936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834c81-bcb0-4aff-87b3-7b190e73823c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:27.787519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:27.788277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:27.788661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:27.789009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:27.789840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:16:27.790227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:27.792023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:27.805422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1165/2322] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:16:27.809796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:27.821229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca69cce-fe45-4bb7-befb-6841ee1a0be1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:27.826208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:27.826929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:27.827312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:27.827501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:27.828216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:27.830228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:27.860833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1158/2323] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:27 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:27.865505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:27.876165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae9a9-f1f7-4e76-85d8-428bb178bb70 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:27.910521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:27.948799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:27.949544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:27.949950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:27.950338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:27.951208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:27.953379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:27.978035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1166/2324] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:27 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:27.983171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:27.995129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344a708-e262-4207-92bd-e6aabccb06c0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.000166 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.001477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.001477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.001477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.002131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.004501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.019172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1159/2325] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:28.022215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.033761 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e8e04-c0fd-4d25-bc6b-06eeb276dd40 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.040029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a7dce-83a0-44a5-9827-7e049afd9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.040029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a7dce-83a0-44a5-9827-7e049afd9219 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.040494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a7dce-83a0-44a5-9827-7e049afd9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.040494 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a7dce-83a0-44a5-9827-7e049afd9219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.041211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a7dce-83a0-44a5-9827-7e049afd9219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.043500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a7dce-83a0-44a5-9827-7e049afd9219 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.055579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1167/2326] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:16:28.059898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.071816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ba06-25ac-4424-96f9-3f00f2f18fa8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.076677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.077590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.077880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.078162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] PATH_INFO: `/v3/projects/629fb92def4c49d6a2ddbc639269c6c2/users/94277b32bb664f1fa2954b9c5d4789ba/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.099350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629fb92def4c49d6a2ddbc639269c6c2, user_id=94277b32bb664f1fa2954b9c5d4789ba, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.102893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.122497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1160/2327] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:28 2022] PUT /identity/v3/projects/629fb92def4c49d6a2ddbc639269c6c2/users/94277b32bb664f1fa2954b9c5d4789ba/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:28.134759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.135184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.135472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.177695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] MFA Rules not processed for user `94277b32bb664f1fa2954b9c5d4789ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:28.179114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:28.276050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1168/2328] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:28.280961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.335715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:28.357629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528885c5-a248-4d52-9e9c-76cad4616708 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.362700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.364107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.364388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.364693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.365427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.367434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.403733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1161/2329] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:28 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:28.405342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.427610 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a20e13-0c43-4b23-8930-67a0f3018d41 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.493129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.493725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.493997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.494270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.494982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.496952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.519302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1169/2330] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:28 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:28.524247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.538422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f01270-c61a-4bc2-a531-aeb5865346a7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.551615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.552315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.552603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.552918 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.553669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.555341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.568697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1162/2331] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:28.573123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.584016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15d96-95d8-4a64-81e7-0cda2c1a6472 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.592496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.593664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.594075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.594364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] PATH_INFO: `/v3/projects/5aecad52a91d44d9b3ea3ab30f37fce6/users/6ede829bd6f6487792df09cf91387171/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.612251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aecad52a91d44d9b3ea3ab30f37fce6, user_id=6ede829bd6f6487792df09cf91387171, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.616521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.632656 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1170/2332] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:28 2022] PUT /identity/v3/projects/5aecad52a91d44d9b3ea3ab30f37fce6/users/6ede829bd6f6487792df09cf91387171/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:28.636696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.649392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8cf64-9107-4eeb-a5a2-f9a4e1b8477c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.716293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ead702-0240-4fab-a785-424467aa9a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.717388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ead702-0240-4fab-a785-424467aa9a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.717795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ead702-0240-4fab-a785-424467aa9a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.718213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ead702-0240-4fab-a785-424467aa9a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.719066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ead702-0240-4fab-a785-424467aa9a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.720802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ead702-0240-4fab-a785-424467aa9a05 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.736776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1163/2333] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:28.741450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.748907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:28.753782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6bcde-bfe5-4140-b08a-a9d81ea36c49 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.760014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:28.760923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.761211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.761495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] PATH_INFO: `/v3/projects/5aecad52a91d44d9b3ea3ab30f37fce6/users/6ede829bd6f6487792df09cf91387171/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.763729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aecad52a91d44d9b3ea3ab30f37fce6, user_id=6ede829bd6f6487792df09cf91387171, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:28.767066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:28.779808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1171/2334] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:28 2022] PUT /identity/v3/projects/5aecad52a91d44d9b3ea3ab30f37fce6/users/6ede829bd6f6487792df09cf91387171/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:16:28.791979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b854c87-5b4f-429a-b290-0c5e9ba43526 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:28.792553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b854c87-5b4f-429a-b290-0c5e9ba43526 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:28.792847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b854c87-5b4f-429a-b290-0c5e9ba43526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:28.823670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8b854c87-5b4f-429a-b290-0c5e9ba43526 None None] MFA Rules not processed for user `6ede829bd6f6487792df09cf91387171`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:28.824324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b854c87-5b4f-429a-b290-0c5e9ba43526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:28.913899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1164/2335] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:28.924776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:28.927961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:28.995904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f23e-cc58-4c83-9df9-6a1a1918cc59 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:28.999681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:29.000655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:29.000817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:29.001083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:29.015632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:29.017222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:29.033636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1172/2336] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:29.618973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d64de-05d8-48c6-b948-585524470673 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:29.619450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d64de-05d8-48c6-b948-585524470673 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:29.619450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d64de-05d8-48c6-b948-585524470673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:29.638752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-925d64de-05d8-48c6-b948-585524470673 None None] MFA Rules not processed for user `9a671e0538ca45bbb44c298f1aa13a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:29.640002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-925d64de-05d8-48c6-b948-585524470673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:29.674853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:29.710273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1165/2337] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:30.558536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:30.632973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d93246-2810-4716-baed-0dfa88dbc060 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:30.637801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:30.638698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:30.639028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:30.639411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] PATH_INFO: `/v3/users/94277b32bb664f1fa2954b9c5d4789ba` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:30.640679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94277b32bb664f1fa2954b9c5d4789ba)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:30.643321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:30.696353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94277b32bb664f1fa2954b9c5d4789ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:30.697201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94277b32bb664f1fa2954b9c5d4789ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:30.705813 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94277b32bb664f1fa2954b9c5d4789ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:30.707145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94277b32bb664f1fa2954b9c5d4789ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:30.715763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94277b32bb664f1fa2954b9c5d4789ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:30.736942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1173/2338] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:30 2022] DELETE /identity/v3/users/94277b32bb664f1fa2954b9c5d4789ba => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:30.742358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:30.742883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:30.742979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:30.763426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:30.764800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:30.830370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1166/2339] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:30.841441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:30.843198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:30.861064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:30.914998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3ab7-8ab1-4472-90d4-0e1c1ce42482 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:30.918779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:30.919472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:30.919762 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:30.920043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:30.930929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:30.932408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:30.942807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1174/2340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:31.260733 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:31.263040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:31.279902 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e52f0-a5ad-4d50-b93e-d3ab44f3241d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:31.285265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:31.286158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:31.286477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:31.286738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] PATH_INFO: `/v3/projects/629fb92def4c49d6a2ddbc639269c6c2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:31.288019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629fb92def4c49d6a2ddbc639269c6c2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:31.290014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:31.340695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629fb92def4c49d6a2ddbc639269c6c2', 'request_id': 'req-c083d1e5-82a6-4078-b663-73e1866e87a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.352887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629fb92def4c49d6a2ddbc639269c6c2', 'request_id': 'req-c083d1e5-82a6-4078-b663-73e1866e87a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.359178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629fb92def4c49d6a2ddbc639269c6c2', 'request_id': 'req-c083d1e5-82a6-4078-b663-73e1866e87a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.374622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] The token cache is being invalidate because project 629fb92def4c49d6a2ddbc639269c6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:31.375348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.375575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.377175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1167/2341] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:31 2022] DELETE /identity/v3/projects/629fb92def4c49d6a2ddbc639269c6c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:31.381819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:31.393451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21554910-1cd8-4692-8673-9d0b1ea92e6a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:31.462892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:31.463988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:31.464606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:31.464989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] PATH_INFO: `/v3/users/6ede829bd6f6487792df09cf91387171` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:31.466496 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ede829bd6f6487792df09cf91387171)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:31.468712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:31.540907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ede829bd6f6487792df09cf91387171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.541940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ede829bd6f6487792df09cf91387171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.559294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ede829bd6f6487792df09cf91387171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.560698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ede829bd6f6487792df09cf91387171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.580571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54de6b68-5883-4f64-a77b-9589e87dd054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ede829bd6f6487792df09cf91387171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:31.604040 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1175/2342] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:31 2022] DELETE /identity/v3/users/6ede829bd6f6487792df09cf91387171 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:32.033294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.035026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:32.056933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083d1e5-82a6-4078-b663-73e1866e87a2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.123119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.124098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.124287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.124713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] PATH_INFO: `/v3/projects/5aecad52a91d44d9b3ea3ab30f37fce6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.125946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aecad52a91d44d9b3ea3ab30f37fce6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.128016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.137590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:32.196260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aecad52a91d44d9b3ea3ab30f37fce6', 'request_id': 'req-035316cf-c2be-41a0-952a-9d9e70d95eb5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:32.210241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aecad52a91d44d9b3ea3ab30f37fce6', 'request_id': 'req-035316cf-c2be-41a0-952a-9d9e70d95eb5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:32.221253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aecad52a91d44d9b3ea3ab30f37fce6', 'request_id': 'req-035316cf-c2be-41a0-952a-9d9e70d95eb5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:32.242394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] The token cache is being invalidate because project 5aecad52a91d44d9b3ea3ab30f37fce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:32.242698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:32.243413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-035316cf-c2be-41a0-952a-9d9e70d95eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:32.245084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1168/2343] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:32 2022] DELETE /identity/v3/projects/5aecad52a91d44d9b3ea3ab30f37fce6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:16:32.250049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.250329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.250614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.272596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:32.273828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:32.318653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:32.358892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1176/2344] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:32.367331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.367732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.368011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.391668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:32.392925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:32.404527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1169/2345] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:32.408790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.419188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9d45-8506-44cd-9631-cfb3e6362654 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.424278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.425049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.425973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.426330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.427191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:16:32.427576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.429295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.443518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1177/2346] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:16:32.448053 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.458848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe45e-6230-4a95-8764-abbfb0d4c399 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.465089 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.465859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.466148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.466427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.467169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.469108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.502923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1170/2347] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:32 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:32.507896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.518576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693f80d-5716-417a-a732-7e1e7515f02f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.603226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.603900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.604205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.604471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.605345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.607325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.637580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1178/2348] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:32 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:16:32.638785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.652254 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6be24-1d4f-4c5a-88c2-67263e57c343 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.657377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.658068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.658357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.658638 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.659479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.661643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.680864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1171/2349] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:32.684960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.696956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666ac32-bb7a-47a6-9c48-2c9ab6ce898f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.702191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530487-b40b-4ec7-9a1d-eff4ad529448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.703441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530487-b40b-4ec7-9a1d-eff4ad529448 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.703717 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530487-b40b-4ec7-9a1d-eff4ad529448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.703993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530487-b40b-4ec7-9a1d-eff4ad529448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.704736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530487-b40b-4ec7-9a1d-eff4ad529448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.706391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530487-b40b-4ec7-9a1d-eff4ad529448 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.719965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1179/2350] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:32.724990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:32.741567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e89a93-4754-42dc-924b-f11118937962 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:32.748382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:32.749446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.749832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.751569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] PATH_INFO: `/v3/projects/a38356bd9ed74da3ad4b5d3f6a7b068c/users/3b38f4da89eb41708db4f09b9277ab09/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.772807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38356bd9ed74da3ad4b5d3f6a7b068c, user_id=3b38f4da89eb41708db4f09b9277ab09, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:32.776470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:32.794320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1172/2351] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:32 2022] PUT /identity/v3/projects/a38356bd9ed74da3ad4b5d3f6a7b068c/users/3b38f4da89eb41708db4f09b9277ab09/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:16:32.814742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:32.815431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:32.816573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:32.861595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] MFA Rules not processed for user `3b38f4da89eb41708db4f09b9277ab09`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:32.864264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:32.949097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1180/2352] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:16:32.953666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.041923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2234f-19e3-4d79-b2d5-4f15be905f7b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.049499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.050326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.050685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.050978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.051813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.055755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.094479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1173/2353] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:32 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:33.096753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.110100 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd012d-38c7-4671-b9a4-eea3526664a6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.170723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:33.216961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.217881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.218025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.218217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.218943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.221152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.246626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1181/2354] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:33 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:33.250457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.268785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f9e33-02c0-45bf-bdde-80ff83d4d56b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.287735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.291779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.291779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.297273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.297273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.297273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.309817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1174/2355] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:33.314769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.334094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f2e59-603f-446b-82c5-da3f10fee28e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.342445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.344269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.344900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.345458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] PATH_INFO: `/v3/projects/cf2c02f94b694c8eaf7ca45775c16826/users/a2d48d3debd9441fa21f22adbeeee30e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.369769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2c02f94b694c8eaf7ca45775c16826, user_id=a2d48d3debd9441fa21f22adbeeee30e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.372750 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.392399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1182/2356] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:33 2022] PUT /identity/v3/projects/cf2c02f94b694c8eaf7ca45775c16826/users/a2d48d3debd9441fa21f22adbeeee30e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:33.399533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.414366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d802dd-a06e-425e-90bb-c29cacb6c4d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.418752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:33.515910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da0103-ba15-49c1-b9b9-d6022cbe1ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.516610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0103-ba15-49c1-b9b9-d6022cbe1ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.516899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0103-ba15-49c1-b9b9-d6022cbe1ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.517179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0103-ba15-49c1-b9b9-d6022cbe1ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.518741 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da0103-ba15-49c1-b9b9-d6022cbe1ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.523696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da0103-ba15-49c1-b9b9-d6022cbe1ad3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.536967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1175/2357] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:33.542683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.558357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41152-2986-450d-8d8b-3bf05a45ce57 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.563604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.565156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.565655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.566709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] PATH_INFO: `/v3/projects/cf2c02f94b694c8eaf7ca45775c16826/users/a2d48d3debd9441fa21f22adbeeee30e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.569848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2c02f94b694c8eaf7ca45775c16826, user_id=a2d48d3debd9441fa21f22adbeeee30e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.572573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.585230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1183/2358] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:33 2022] PUT /identity/v3/projects/cf2c02f94b694c8eaf7ca45775c16826/users/a2d48d3debd9441fa21f22adbeeee30e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:33.596072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.596375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.596661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.634144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] MFA Rules not processed for user `a2d48d3debd9441fa21f22adbeeee30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:33.636107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:33.719355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1176/2359] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:33.730921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.733020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:33.799981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f8d4-76e7-4e57-afa8-982053722933 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.804075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.804745 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.805035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.805314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:33.815502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:33.818864 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:33.830991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1184/2360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:33.945580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:33.955577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adac17d-20df-40a4-8a50-a5eb68636d4e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:33.962609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7d800-b8d4-47b6-a899-26165b74224b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:33.963303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7d800-b8d4-47b6-a899-26165b74224b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:33.963596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7d800-b8d4-47b6-a899-26165b74224b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:33.963878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7d800-b8d4-47b6-a899-26165b74224b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:34.034099 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7d800-b8d4-47b6-a899-26165b74224b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:34.037035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7d800-b8d4-47b6-a899-26165b74224b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:34.050900 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1177/2361] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:36.666790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:36.741216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69629f-0d55-4c89-8eab-5f3e25b24948 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:36.746640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:36.746836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:36.747015 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:36.747334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] PATH_INFO: `/v3/users/3b38f4da89eb41708db4f09b9277ab09` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:36.748592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b38f4da89eb41708db4f09b9277ab09)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:36.750525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:36.791516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:36.814269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b38f4da89eb41708db4f09b9277ab09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:36.819890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b38f4da89eb41708db4f09b9277ab09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:36.833444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b38f4da89eb41708db4f09b9277ab09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:36.834909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b38f4da89eb41708db4f09b9277ab09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:36.843444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b38f4da89eb41708db4f09b9277ab09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:36.874789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1185/2362] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:36 2022] DELETE /identity/v3/users/3b38f4da89eb41708db4f09b9277ab09 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:36.882678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:36.883212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:36.883422 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:36.917790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:36.919221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:36.950729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:37.013881 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1178/2363] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:37.028854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:37.031860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:37.125364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5075c36-2bdb-46d7-a885-616d18d1b410 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:37.129233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:37.129941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:37.131302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:37.131598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:37.142842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:37.146206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:37.156829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1186/2364] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:37.712201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:37.713697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:37.727279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ee500-6815-47aa-9790-e5c4d3faa30c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:37.732732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:37.733614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:37.734063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:37.734616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] PATH_INFO: `/v3/projects/a38356bd9ed74da3ad4b5d3f6a7b068c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:37.735896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38356bd9ed74da3ad4b5d3f6a7b068c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:37.738107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:37.811527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38356bd9ed74da3ad4b5d3f6a7b068c', 'request_id': 'req-9ffedc4e-aeaa-4038-a048-5739dffc566e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:37.820452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38356bd9ed74da3ad4b5d3f6a7b068c', 'request_id': 'req-9ffedc4e-aeaa-4038-a048-5739dffc566e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:37.826763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38356bd9ed74da3ad4b5d3f6a7b068c', 'request_id': 'req-9ffedc4e-aeaa-4038-a048-5739dffc566e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:37.844281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] The token cache is being invalidate because project a38356bd9ed74da3ad4b5d3f6a7b068c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:37.844848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:37.845585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:37.848351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1179/2365] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:37 2022] DELETE /identity/v3/projects/a38356bd9ed74da3ad4b5d3f6a7b068c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:37.852143 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:37.864916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d7fc-3b53-4f00-ac79-daf8ba419a92 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:37.945141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:37.946048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:37.946383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:37.946668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] PATH_INFO: `/v3/users/a2d48d3debd9441fa21f22adbeeee30e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:37.948025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d48d3debd9441fa21f22adbeeee30e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:37.950115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:38.006420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d48d3debd9441fa21f22adbeeee30e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.007016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d48d3debd9441fa21f22adbeeee30e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.009129 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:38.016538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d48d3debd9441fa21f22adbeeee30e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.017574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d48d3debd9441fa21f22adbeeee30e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.029997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b0be96a3-70c1-4079-9acd-ff3ca026c7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d48d3debd9441fa21f22adbeeee30e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.064013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1187/2366] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:37 2022] DELETE /identity/v3/users/a2d48d3debd9441fa21f22adbeeee30e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:38.384978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:38.386504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:38.402340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffedc4e-aeaa-4038-a048-5739dffc566e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:38.468300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:38.469346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.469642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.469920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] PATH_INFO: `/v3/projects/cf2c02f94b694c8eaf7ca45775c16826` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.471176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2c02f94b694c8eaf7ca45775c16826)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:38.473816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:38.531386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2c02f94b694c8eaf7ca45775c16826', 'request_id': 'req-22ec3749-0281-4399-af3e-58815402f641'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.534452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:38.540830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2c02f94b694c8eaf7ca45775c16826', 'request_id': 'req-22ec3749-0281-4399-af3e-58815402f641'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.547841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2c02f94b694c8eaf7ca45775c16826', 'request_id': 'req-22ec3749-0281-4399-af3e-58815402f641'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.564360 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] The token cache is being invalidate because project cf2c02f94b694c8eaf7ca45775c16826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:38.567062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.567976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22ec3749-0281-4399-af3e-58815402f641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:38.570262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1180/2367] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:38 2022] DELETE /identity/v3/projects/cf2c02f94b694c8eaf7ca45775c16826 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:38.577899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.577899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.577899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.600735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:38.602387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:38.674738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1188/2368] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:38.684129 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.684490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.684780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.713174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:38.714469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:38.722864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1181/2369] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:38.727697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:38.741573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848009-9b7f-4261-940c-91ad25db99cb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:38.746417 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:38.747183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.747532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.747894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.748697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:16:38.749089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:38.750889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:38.769271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1189/2370] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:16:38.773899 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:38.783651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac8199-f9f1-4ecc-b63a-7bb9b266ca74 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:38.789554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:38.790381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.790674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.790980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.791670 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:38.793691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:38.822192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1182/2371] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:38 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:38.828532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:38.842335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c955-edf7-45c8-aa2b-57bec47135dc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:38.904818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:38.905733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.905836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.906039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.906743 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:38.908708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:38.935585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1190/2372] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:38 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:38.940154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:38.951493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14a8e-78b9-493b-bba8-453596b4fd00 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:38.957887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:38.958570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.958858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.959170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.959950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:38.961597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:38.974032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1183/2373] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:38.978236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:38.992373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1edf5-e8a5-4fd6-92be-9dfe51e1098a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:38.997118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22bf4-6490-4514-931c-9a7e9f413946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:38.997783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22bf4-6490-4514-931c-9a7e9f413946 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:38.998082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22bf4-6490-4514-931c-9a7e9f413946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:38.998361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22bf4-6490-4514-931c-9a7e9f413946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:38.999117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22bf4-6490-4514-931c-9a7e9f413946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:39.000748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22bf4-6490-4514-931c-9a7e9f413946 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:39.011823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1191/2374] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:39.016250 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:39.028600 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad6873-eb4b-4844-9b40-8a0c8b69c1e4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:39.035303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:39.036395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:39.036731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:39.037017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] PATH_INFO: `/v3/projects/7a06c2c43aaf4bdaa176cac1e726b4ec/users/13c218159d1e46369704a9bcb35e1523/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:39.056667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a06c2c43aaf4bdaa176cac1e726b4ec, user_id=13c218159d1e46369704a9bcb35e1523, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:39.059416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:39.074403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1184/2375] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:39 2022] PUT /identity/v3/projects/7a06c2c43aaf4bdaa176cac1e726b4ec/users/13c218159d1e46369704a9bcb35e1523/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:39.087006 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:39.087358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:39.087639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:39.119478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] MFA Rules not processed for user `13c218159d1e46369704a9bcb35e1523`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:39.120863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:39.146044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:39.205726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1192/2376] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:39.246032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:39.247806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:39.335696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deab6c-56e8-46f4-a279-38c47a672b3f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:39.339379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46bba1-db0d-409e-a3a2-d35962aa385a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:39.340034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46bba1-db0d-409e-a3a2-d35962aa385a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:39.340321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46bba1-db0d-409e-a3a2-d35962aa385a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:39.340606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46bba1-db0d-409e-a3a2-d35962aa385a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:39.350580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46bba1-db0d-409e-a3a2-d35962aa385a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:39.352107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46bba1-db0d-409e-a3a2-d35962aa385a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:39.362123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1185/2377] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:39.382724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:39.457907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5d67b-e7b8-449c-832f-92dcb447b4bf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:39.462486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:39.463470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:39.463758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:39.464039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] PATH_INFO: `/v3/users/13c218159d1e46369704a9bcb35e1523` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:39.465250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c218159d1e46369704a9bcb35e1523)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:39.467228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:39.519281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c218159d1e46369704a9bcb35e1523'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:39.519975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c218159d1e46369704a9bcb35e1523'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:39.527277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c218159d1e46369704a9bcb35e1523'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:39.527940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c218159d1e46369704a9bcb35e1523'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:39.537042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c218159d1e46369704a9bcb35e1523'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:39.556020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1193/2378] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:16:39 2022] DELETE /identity/v3/users/13c218159d1e46369704a9bcb35e1523 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:39.563971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:39.564517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:39.564517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:39.583359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:39.584621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:39.646776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1186/2379] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:39.656675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:39.658363 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:39.707047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:39.722481 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f7ae8-0eaa-4515-82a6-061cef67dd32 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:39.726593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124d874-8f5c-4309-9efc-63394aa796bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:39.727318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d874-8f5c-4309-9efc-63394aa796bb service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:39.727612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d874-8f5c-4309-9efc-63394aa796bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:39.727895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d874-8f5c-4309-9efc-63394aa796bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:39.738468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d874-8f5c-4309-9efc-63394aa796bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:39.739957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d874-8f5c-4309-9efc-63394aa796bb service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:39.752134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1194/2380] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:40.138202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.139692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:40.153928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0362b9-b88c-4cdc-9cc1-c297b62943d3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.159065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.161279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.161577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.161872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] PATH_INFO: `/v3/projects/7a06c2c43aaf4bdaa176cac1e726b4ec` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.163218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a06c2c43aaf4bdaa176cac1e726b4ec)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.165200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.185232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:40.230728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a06c2c43aaf4bdaa176cac1e726b4ec', 'request_id': 'req-68826fd0-a577-4ef6-b6c4-3d4264b072df'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:40.238370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a06c2c43aaf4bdaa176cac1e726b4ec', 'request_id': 'req-68826fd0-a577-4ef6-b6c4-3d4264b072df'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:40.244877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a06c2c43aaf4bdaa176cac1e726b4ec', 'request_id': 'req-68826fd0-a577-4ef6-b6c4-3d4264b072df'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:40.265640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] The token cache is being invalidate because project 7a06c2c43aaf4bdaa176cac1e726b4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:16:40.265926 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:40.266585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68826fd0-a577-4ef6-b6c4-3d4264b072df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:16:40.268462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1187/2381] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:16:40 2022] DELETE /identity/v3/projects/7a06c2c43aaf4bdaa176cac1e726b4ec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:40.277085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.277580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.277698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.297313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:40.297704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:40.357653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1195/2382] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:40.365996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.366322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.366632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.386514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:40.387778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:40.397843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1188/2383] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:40.402324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.412937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7463-1b10-4bb6-9c84-cfc34befff71 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.417593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.418257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.418544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.418825 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.419609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:16:40.419924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.421524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.435055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1196/2384] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:16:40.439685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.450221 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe08e-9be7-44ea-bc75-5a32ff232262 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.455543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.456891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.457241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.457552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.458279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.460253 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.490304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1189/2385] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:40 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:40.494446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.504474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8298a98-76b2-4774-84cc-52fd092d2661 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.563375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.564150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.564434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.564715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.565420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.568315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.596056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1197/2386] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:40 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:40.600247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.610544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6473d8-ef01-4f2d-a0f0-a9ff559ebbf4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.615523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.616196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.616480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.616759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.617490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.619133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.630513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1190/2387] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:40.634611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.645898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c291966-f097-4107-a307-6c82a2e8aba6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.650637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7fb52-f679-4300-9eec-7490de954c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.651334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7fb52-f679-4300-9eec-7490de954c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.651618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7fb52-f679-4300-9eec-7490de954c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.651917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7fb52-f679-4300-9eec-7490de954c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.652680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7fb52-f679-4300-9eec-7490de954c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.654222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7fb52-f679-4300-9eec-7490de954c60 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.664781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1198/2388] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:40.668914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.679812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd7b27-1b33-4994-ad0e-bbaf2702482c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.684510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.685381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.685661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.685934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] PATH_INFO: `/v3/projects/1da6b127a0d64f8892c4935ef08ed679/users/e55884035fd3441583ece37dd8eb9248/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.704219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da6b127a0d64f8892c4935ef08ed679, user_id=e55884035fd3441583ece37dd8eb9248, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.706933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.721155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1191/2389] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:40 2022] PUT /identity/v3/projects/1da6b127a0d64f8892c4935ef08ed679/users/e55884035fd3441583ece37dd8eb9248/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:40.726450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1dd1c-346e-44d1-a00a-3cb0189d7c12 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.726764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1dd1c-346e-44d1-a00a-3cb0189d7c12 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.727027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1dd1c-346e-44d1-a00a-3cb0189d7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.747001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-19a1dd1c-346e-44d1-a00a-3cb0189d7c12 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:40.748279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-19a1dd1c-346e-44d1-a00a-3cb0189d7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:40.797680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:40.814307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1199/2390] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:40.824634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:40.826468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:40.887406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963233-26df-4150-88d6-078b0c02a3ba admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:40.891439 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:40.892278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:40.892444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:40.892748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:40.903159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:40.904539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:40.914906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1192/2391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:16:46.159510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.160489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.160489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.200535 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] MFA Rules not processed for user `e55884035fd3441583ece37dd8eb9248`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:46.201772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:46.329175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1200/2392] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:46.334449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:46.347896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eee76-6602-442c-acd8-8791fbc7c089 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:46.360124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:46.360819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.361109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.361393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.362107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:46.364182 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:46.404301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1193/2393] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:16:46 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:46.413020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:46.427839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612268-95f8-4b69-aa3e-102d1b80f407 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:46.537577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:46.538286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.538572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.538856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.539902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:46.541903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:46.571165 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1201/2394] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:16:46 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:16:46.576256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:46.588721 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a91b4-1e51-4d75-bca6-6dd414f25e50 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:46.594019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:46.594829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.595017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.595374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.596229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:46.599047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:46.615986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1194/2395] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:46.620738 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:46.632133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d89b1-4478-486d-b282-ed493eac8bc6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:46.638822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:46.639879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.640219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.640575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] PATH_INFO: `/v3/projects/f77dc1d8a7a04a96a7ce93e489e09fac/users/875e56e37d91463a8c234eca64661b7f/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.663572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77dc1d8a7a04a96a7ce93e489e09fac, user_id=875e56e37d91463a8c234eca64661b7f, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:46.666515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:46.693005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1202/2396] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:46 2022] PUT /identity/v3/projects/f77dc1d8a7a04a96a7ce93e489e09fac/users/875e56e37d91463a8c234eca64661b7f/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:46.694931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:46.711755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c676ec1-5615-49ee-a8cd-c5f400fb675b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:46.718040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:46.783533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba67e51-1fda-4a9e-a7ee-afa2fe19beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:46.784334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67e51-1fda-4a9e-a7ee-afa2fe19beea admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.784635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67e51-1fda-4a9e-a7ee-afa2fe19beea admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.785036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67e51-1fda-4a9e-a7ee-afa2fe19beea admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.785821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba67e51-1fda-4a9e-a7ee-afa2fe19beea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:46.787548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba67e51-1fda-4a9e-a7ee-afa2fe19beea admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:46.800892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1195/2397] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:16:46.806284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:46.819164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083c93-3b45-48bc-b50b-80a6c7caad6e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:46.824613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:46.827942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:46.827942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:46.827942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] PATH_INFO: `/v3/projects/f77dc1d8a7a04a96a7ce93e489e09fac/users/875e56e37d91463a8c234eca64661b7f/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:46.828428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77dc1d8a7a04a96a7ce93e489e09fac, user_id=875e56e37d91463a8c234eca64661b7f, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:46.832125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:46.848202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1203/2398] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:16:46 2022] PUT /identity/v3/projects/f77dc1d8a7a04a96a7ce93e489e09fac/users/875e56e37d91463a8c234eca64661b7f/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:16:51.698923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36fb89-501c-40ed-9896-8b49321dc3d5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:51.699602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36fb89-501c-40ed-9896-8b49321dc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:51.699602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36fb89-501c-40ed-9896-8b49321dc3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:51.729593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5b36fb89-501c-40ed-9896-8b49321dc3d5 None None] MFA Rules not processed for user `875e56e37d91463a8c234eca64661b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:16:51.730723 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5b36fb89-501c-40ed-9896-8b49321dc3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:51.806432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1196/2399] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:16:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:16:51.821266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:16:51.822990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:16:51.859784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:51.904787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526065-7e8c-451a-9421-61187859fb22 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:16:51.911002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:16:51.911757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:16:51.912048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:16:51.912330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:16:51.969275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:16:51.971004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:16:51.981454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1204/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:16:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:17:01.803411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=59 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:01.976953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=41 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:27.333446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:17:27.334006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:17:27.334148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:17:27.358925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] MFA Rules not processed for user `e55884035fd3441583ece37dd8eb9248`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:17:27.360413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:17:27.367876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1197/2401] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:17:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:17:28.633309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:17:28.634727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:17:28.707057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb174-f78f-4393-b894-4612add24fb8 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:17:28.712118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:17:28.712767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:17:28.713048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:17:28.713321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:17:28.715069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:17:28.726933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:17:28.728537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:17:28.738513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1205/2402] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:17:37.353134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:38.734294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=32 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:48.460332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:17:48.461744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:17:48.522385 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482220-46ff-475e-9de7-bbcf19c6bf68 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:17:48.526066 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:17:48.526717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:17:48.527006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:17:48.527319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:17:48.536590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:17:48.538041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:17:48.547613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1198/2403] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:17:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:17:57.088435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:17:57.098181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef38e7e-53eb-484c-9e05-6d444f5c0e29 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:17:57.102222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:17:57.102905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:17:57.103238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:17:57.103525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:17:57.105345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:17:57.166125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:17:57.167596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f493bb4-595b-44ba-ae80-65c82ee088c9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:17:57.177368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1206/2404] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:17:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:17:58.543328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=26 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:03.105870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:03.117692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf363e-d8e1-42cf-95e3-d697e03ab0d3 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:03.122318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:03.122971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:03.123306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:03.123590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:03.126117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:03.201187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:03.202888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14094251-7b72-4403-a3e8-0156bddf03b1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:03.213892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1199/2405] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:18:06.904224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609b020-d0d0-4d2d-8b33-aeed09612b8c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:06.904769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609b020-d0d0-4d2d-8b33-aeed09612b8c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:06.904868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609b020-d0d0-4d2d-8b33-aeed09612b8c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:06.906257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1207/2406] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:18:06.923346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:06.923810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:06.924034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:06.961510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] MFA Rules not processed for user `5581ec9275db47fa96f784326ec51e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:18:06.962739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:06.972466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1200/2407] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:18:06.987173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609b020-d0d0-4d2d-8b33-aeed09612b8c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:06.989045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e609b020-d0d0-4d2d-8b33-aeed09612b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:07.011464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609b020-d0d0-4d2d-8b33-aeed09612b8c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:07.016545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:07.017451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:07.017741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:07.018828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:07.027851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:07.029639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:07.043747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1208/2408] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:18:11.030654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:11.032548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:11.047114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3b55e-e993-497a-9a41-33cabe63895b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:11.052496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:11.053377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:11.053667 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:11.054134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] PATH_INFO: `/v3/users/c861e4c9be0b4e7ab86df8ec362013f1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:11.055395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c861e4c9be0b4e7ab86df8ec362013f1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:11.057895 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:11.116073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c861e4c9be0b4e7ab86df8ec362013f1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.125323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c861e4c9be0b4e7ab86df8ec362013f1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.126016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c861e4c9be0b4e7ab86df8ec362013f1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.140746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c861e4c9be0b4e7ab86df8ec362013f1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.141823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c861e4c9be0b4e7ab86df8ec362013f1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.157384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1201/2409] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:18:11 2022] DELETE /identity/v3/users/c861e4c9be0b4e7ab86df8ec362013f1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:18:11.391466 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:11.406177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f39be-bfbe-412e-9323-c941f1b4f94d service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:11.474437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:11.475435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:11.475726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:11.476012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] PATH_INFO: `/v3/projects/070367cab3334be48e0644598d755492` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:11.477205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070367cab3334be48e0644598d755492)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:11.479149 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:11.531274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070367cab3334be48e0644598d755492', 'request_id': 'req-124f3da4-0d6d-4902-b2a9-551dd137a110'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.541294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070367cab3334be48e0644598d755492', 'request_id': 'req-124f3da4-0d6d-4902-b2a9-551dd137a110'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.548151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070367cab3334be48e0644598d755492', 'request_id': 'req-124f3da4-0d6d-4902-b2a9-551dd137a110'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.561245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] The token cache is being invalidate because project 070367cab3334be48e0644598d755492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:18:11.561709 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.562427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.564474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1209/2410] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:18:11 2022] DELETE /identity/v3/projects/070367cab3334be48e0644598d755492 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:18:11.569476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:11.571285 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:11.585620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6569d-6981-4536-b709-637d4068e13b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:11.643851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:11.656782 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:11.657671 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:11.658132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:11.658920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] PATH_INFO: `/v3/users/5a436ea2ae9d4c568f2ecab274ed9b6b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:11.660383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a436ea2ae9d4c568f2ecab274ed9b6b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:11.662533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:11.711155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a436ea2ae9d4c568f2ecab274ed9b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.719657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a436ea2ae9d4c568f2ecab274ed9b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.720301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a436ea2ae9d4c568f2ecab274ed9b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.735008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a436ea2ae9d4c568f2ecab274ed9b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.735826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b7d258f6-77dd-4a0b-bb4b-0d9f70c21803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a436ea2ae9d4c568f2ecab274ed9b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:11.749808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1202/2411] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:18:11 2022] DELETE /identity/v3/users/5a436ea2ae9d4c568f2ecab274ed9b6b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:18:11.936727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:11.938312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:11.953555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f3da4-0d6d-4902-b2a9-551dd137a110 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:11.972275 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:12.030092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:12.030092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:12.030092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:12.030092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] PATH_INFO: `/v3/projects/cd2d731872f346d689e9f7b2f276b634` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:12.030573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2d731872f346d689e9f7b2f276b634)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:12.030682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:12.082675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2d731872f346d689e9f7b2f276b634', 'request_id': 'req-0c4b972b-74de-4e74-a562-6514ef58e662'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:12.090553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2d731872f346d689e9f7b2f276b634', 'request_id': 'req-0c4b972b-74de-4e74-a562-6514ef58e662'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:12.098104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2d731872f346d689e9f7b2f276b634', 'request_id': 'req-0c4b972b-74de-4e74-a562-6514ef58e662'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:12.108547 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] The token cache is being invalidate because project cd2d731872f346d689e9f7b2f276b634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:18:12.108763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:12.109442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:18:12.110986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1210/2412] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:18:11 2022] DELETE /identity/v3/projects/cd2d731872f346d689e9f7b2f276b634 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:18:12.764905 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:12.765419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:12.765520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:12.783625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] MFA Rules not processed for user `1421fb674ae04d6ea9ae342b73ce8115`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:18:12.784837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:12.840028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1203/2413] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:18:22.105343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:22.833235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:39.921352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:39.922885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:39.980511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b972b-74de-4e74-a562-6514ef58e662 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:39.984163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:39.984842 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:39.985123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:39.985401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:39.987261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:40.063218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:40.065237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6895508-1ad6-4fd5-9247-ef362fa01543 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:40.076312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1211/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:18:41.250610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:41.260821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfda8a-a9c8-4982-9fe4-101a62abcc13 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:41.264381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:41.265024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:41.265314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:41.265596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:41.267641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:41.280824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:41.282261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:41.293474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1204/2415] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:18:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:18:50.071422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=54 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:50.629389 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:50.629661 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:50.629952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:50.648599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:18:50.649889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:50.708874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1212/2416] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:18:50.755078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:18:50.756576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:18:50.830305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511fa28-00ac-4451-a948-15b24e2a839a service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:18:50.835504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9a79-777f-4b41-8abd-2574e8d009f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:18:50.836157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9a79-777f-4b41-8abd-2574e8d009f9 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:18:50.836447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9a79-777f-4b41-8abd-2574e8d009f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:18:50.836730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9a79-777f-4b41-8abd-2574e8d009f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:18:50.844884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9a79-777f-4b41-8abd-2574e8d009f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:18:50.846771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9a79-777f-4b41-8abd-2574e8d009f9 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:18:50.854822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1205/2417] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:19:00.701313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:00.851573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=38 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:01.427354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:01.428711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:01.446254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70387d-4bff-4e54-800b-97f4ccba871d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:01.451997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:01.452642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:01.452924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:01.453199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:01.455586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:01.546742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:01.549424 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15225f84-cf00-448d-9c4a-a4ad37f0656c service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:01.572444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1213/2418] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:11.569521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=41 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:12.113781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a793-1f7d-4440-93c5-99c6fc90208a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.114389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a793-1f7d-4440-93c5-99c6fc90208a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.114539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a793-1f7d-4440-93c5-99c6fc90208a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.116186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1206/2419] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:19:12.123971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbefa3-49fc-4888-a332-efbf4085d10e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.124340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbefa3-49fc-4888-a332-efbf4085d10e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.124690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbefa3-49fc-4888-a332-efbf4085d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.144027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ffcbefa3-49fc-4888-a332-efbf4085d10e None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:12.145307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ffcbefa3-49fc-4888-a332-efbf4085d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:12.155258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1214/2420] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:12.175130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540a793-1f7d-4440-93c5-99c6fc90208a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:12.177038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1540a793-1f7d-4440-93c5-99c6fc90208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:12.243329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540a793-1f7d-4440-93c5-99c6fc90208a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:12.250972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e08cb-2ced-46c4-b94d-2f1bd26ceb46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:12.250972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e08cb-2ced-46c4-b94d-2f1bd26ceb46 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.250972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e08cb-2ced-46c4-b94d-2f1bd26ceb46 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.250972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e08cb-2ced-46c4-b94d-2f1bd26ceb46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.258885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e08cb-2ced-46c4-b94d-2f1bd26ceb46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:12.260359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e08cb-2ced-46c4-b94d-2f1bd26ceb46 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:12.272032 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1207/2421] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:12.336986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af8d77-41f3-489e-a5bd-7e4467599830 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.337220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af8d77-41f3-489e-a5bd-7e4467599830 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.337484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af8d77-41f3-489e-a5bd-7e4467599830 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.338877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1215/2422] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:19:12.343700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c51e-1fd8-4ad8-bc5b-91b91851746b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.343994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c51e-1fd8-4ad8-bc5b-91b91851746b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.344277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c51e-1fd8-4ad8-bc5b-91b91851746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.380725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-22f6c51e-1fd8-4ad8-bc5b-91b91851746b None None] MFA Rules not processed for user `4ae41b54b0504beb90cbd3da87c8f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:12.381939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-22f6c51e-1fd8-4ad8-bc5b-91b91851746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:12.388529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1208/2423] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:12.401033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af8d77-41f3-489e-a5bd-7e4467599830 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:12.412211 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af8d77-41f3-489e-a5bd-7e4467599830 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:12.415913 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bad50-89b5-470e-b54a-aa4d39ab86ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:12.416574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bad50-89b5-470e-b54a-aa4d39ab86ab service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.416856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bad50-89b5-470e-b54a-aa4d39ab86ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.417138 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bad50-89b5-470e-b54a-aa4d39ab86ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.424295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bad50-89b5-470e-b54a-aa4d39ab86ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:12.425725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bad50-89b5-470e-b54a-aa4d39ab86ab service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:12.433453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1216/2424] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:12.513501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf54ab-ce08-4d7d-98e1-aa67bc97133d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.513798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf54ab-ce08-4d7d-98e1-aa67bc97133d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.514114 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf54ab-ce08-4d7d-98e1-aa67bc97133d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.515544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1209/2425] 10.222.0.45 () {54 vars in 921 bytes} [Thu May 26 15:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 15:19:12.521685 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.521981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.522268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.540929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] MFA Rules not processed for user `6351122de1824cdf901a0943f64a1b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:12.542139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:12.552301 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1217/2426] 10.222.0.45 () {58 vars in 1018 bytes} [Thu May 26 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:12.562888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf54ab-ce08-4d7d-98e1-aa67bc97133d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:12.575303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf54ab-ce08-4d7d-98e1-aa67bc97133d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:12.578958 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:12.580300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.580601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.580883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.591609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:12.593054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:12.605440 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1210/2427] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:12.694744 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:12.696265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:12.770920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53fe7d-b047-4143-8c75-6d048c6e44aa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:12.776021 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:12.776662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:12.776946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:12.777222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:12.778967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:12.790974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:12.792587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85824eaa-a751-4c65-b32b-97743a517e02 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:12.802453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1218/2428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:13.977840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:13.987411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3de4-26fc-4ba6-81fe-4500bdc080d8 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:13.991786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:13.992090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:13.992851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:13.993080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:13.995035 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:14.005736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:14.007124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:14.015645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1211/2429] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:14.940526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7e12-0434-4961-ac9a-e9f382989979 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:14.940526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7e12-0434-4961-ac9a-e9f382989979 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:14.940526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7e12-0434-4961-ac9a-e9f382989979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:14.961205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-75bf7e12-0434-4961-ac9a-e9f382989979 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:14.962577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-75bf7e12-0434-4961-ac9a-e9f382989979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:14.970476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1219/2430] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:14.984477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:15.002739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a2b7-054f-45aa-82f8-db1d97f6c6e0 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:15.008932 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:15.009807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:15.010202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:15.010593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:15.021377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:15.023454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:15.042186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1212/2431] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:19:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:19:24.954777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=47 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:25.033774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=53 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:34.434887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:34.435404 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:34.435505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:34.454047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:34.455281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:34.463018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1220/2432] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:34.477007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:34.488303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe3d46-1d58-4258-8bf6-d64ca50d63f7 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:34.493376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:34.494013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:34.494301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:34.494582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:34.503435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:34.505047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:34.513420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1213/2433] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:19:35.978039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:35.988092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c3f39-8944-4055-8f04-bb76a8a1f27d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:35.991958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:35.992636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:35.992925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:35.993207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:35.994991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:36.059908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:36.061348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:36.071349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1221/2434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:39.281229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:39.283658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:39.301423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787be0f8-bf91-4d5a-bf51-267666c474fe service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:39.306048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:39.307010 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:39.307332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:39.307614 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] PATH_INFO: `/v3/users/9a671e0538ca45bbb44c298f1aa13a37` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:39.322358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a671e0538ca45bbb44c298f1aa13a37)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:39.324351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:39.369919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a671e0538ca45bbb44c298f1aa13a37'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.377576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a671e0538ca45bbb44c298f1aa13a37'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.378293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a671e0538ca45bbb44c298f1aa13a37'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.390288 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a671e0538ca45bbb44c298f1aa13a37'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.390934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3c8a20ef-8146-4e7a-aa3f-0b0cf75d65f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a671e0538ca45bbb44c298f1aa13a37'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.404756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1214/2435] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:19:39 2022] DELETE /identity/v3/users/9a671e0538ca45bbb44c298f1aa13a37 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:39.578564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:39.590902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27327d0-c660-41c6-83cd-180075fc8d41 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:39.653604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:39.654390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:39.654674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:39.654951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] PATH_INFO: `/v3/projects/85ea8fbf32d748a8ad70996a9fa12843` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:39.666444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ea8fbf32d748a8ad70996a9fa12843)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:39.668420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:39.714265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ea8fbf32d748a8ad70996a9fa12843', 'request_id': 'req-846b534e-0dfe-4cb6-84b8-82962e899e11'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.723022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ea8fbf32d748a8ad70996a9fa12843', 'request_id': 'req-846b534e-0dfe-4cb6-84b8-82962e899e11'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.730518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ea8fbf32d748a8ad70996a9fa12843', 'request_id': 'req-846b534e-0dfe-4cb6-84b8-82962e899e11'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.741167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] The token cache is being invalidate because project 85ea8fbf32d748a8ad70996a9fa12843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:19:39.741458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.742112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-846b534e-0dfe-4cb6-84b8-82962e899e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:39.743702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1222/2436] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:19:39 2022] DELETE /identity/v3/projects/85ea8fbf32d748a8ad70996a9fa12843 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:39.748547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:39.748843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:39.749130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:39.768991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:39.770436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:39.829605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1215/2437] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:39.837556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a022129-0460-4d39-937f-432d4536f53b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:39.837845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a022129-0460-4d39-937f-432d4536f53b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:39.838124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a022129-0460-4d39-937f-432d4536f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:39.856276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6a022129-0460-4d39-937f-432d4536f53b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:39.857473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6a022129-0460-4d39-937f-432d4536f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:39.866122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1223/2438] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:39.870460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:39.880513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1685006-cd73-4b7c-8025-32a9eb0aed90 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:39.885206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:39.885864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:39.886151 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:39.886430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:39.887200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:19:39.887512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:39.889115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:39.901203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1216/2439] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:19:39.905730 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a022129-0460-4d39-937f-432d4536f53b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:39.911339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:39.917487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a022129-0460-4d39-937f-432d4536f53b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:39.923259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:39.923937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:39.924224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:39.924508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:39.925214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:39.927164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:39.953456 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1224/2440] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:19:39 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:19:39.958336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:39.968485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc0c8-8404-4e84-ad26-1a7067e4c1a2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.001891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:40.028831 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.029506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.029790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.030063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.030750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.032814 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.053495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1217/2441] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:19:39 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:19:40.057726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.069065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f61d-c89f-4d5a-afe8-07f67c827bac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.074153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.074826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.075146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.075433 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.076191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.077802 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.088044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1225/2442] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:19:40.091976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.102476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e6f8-9f9c-4513-9c2d-1a90f1b95ae3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.107185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cdbb3-569b-4c01-8012-73fffacaa06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.107834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cdbb3-569b-4c01-8012-73fffacaa06a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.108119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cdbb3-569b-4c01-8012-73fffacaa06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.108399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cdbb3-569b-4c01-8012-73fffacaa06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.109117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cdbb3-569b-4c01-8012-73fffacaa06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.111311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cdbb3-569b-4c01-8012-73fffacaa06a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.121106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1218/2443] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:19:40.125289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.135402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234ec0-cb08-4a06-ba69-7504701f9290 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.140123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.140999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.141304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.141865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] PATH_INFO: `/v3/projects/5c24fa7ca4ad444e80034fdab502fbf9/users/c9b2b1c0c9c741c791847e84aa3d9e54/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.156502 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c24fa7ca4ad444e80034fdab502fbf9, user_id=c9b2b1c0c9c741c791847e84aa3d9e54, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.159740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.174356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1226/2444] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:19:40 2022] PUT /identity/v3/projects/5c24fa7ca4ad444e80034fdab502fbf9/users/c9b2b1c0c9c741c791847e84aa3d9e54/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:40.185248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.185542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.185825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.211880 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] MFA Rules not processed for user `c9b2b1c0c9c741c791847e84aa3d9e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:40.213104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:40.277370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1219/2445] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:40.281973 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.343443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fe99-cd10-4433-ba03-5a5e97822afe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.348171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.348824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.349107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.349383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.350073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.352007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.377573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1227/2446] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:19:40 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:19:40.381683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.392863 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae0a62-db6f-4032-97a2-c4d324339da2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.449370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.449965 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.450256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.450540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.451265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.453206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.473688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1220/2447] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:19:40 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:19:40.477622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.489341 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477f1d9-8879-4da4-9a17-16428f049182 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.494033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.494689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.494970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.495277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.496000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.497618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.509264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1228/2448] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:19:40.513379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.523767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e219d-bc2d-46c9-bf79-8f94485d3947 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.528525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.529399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.529689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.529971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] PATH_INFO: `/v3/projects/84eeed1eb0ed42228682d8259de27db5/users/381d81a2f2084dca83ec9db5396c812c/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.556127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eeed1eb0ed42228682d8259de27db5, user_id=381d81a2f2084dca83ec9db5396c812c, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.558943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.572865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1221/2449] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:19:40 2022] PUT /identity/v3/projects/84eeed1eb0ed42228682d8259de27db5/users/381d81a2f2084dca83ec9db5396c812c/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:40.576817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.587068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c7670-fbfe-4372-8b42-99488fd6742e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.644705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eacfa-ce8c-4999-b3db-59af7b03d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.645377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eacfa-ce8c-4999-b3db-59af7b03d484 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.645668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eacfa-ce8c-4999-b3db-59af7b03d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.645953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eacfa-ce8c-4999-b3db-59af7b03d484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.646680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eacfa-ce8c-4999-b3db-59af7b03d484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.648334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eacfa-ce8c-4999-b3db-59af7b03d484 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.658989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1229/2450] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:19:40.663115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.673363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775668b3-4854-4521-ae25-4ff48344f561 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.677953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.678875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.679199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.679483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] PATH_INFO: `/v3/projects/84eeed1eb0ed42228682d8259de27db5/users/381d81a2f2084dca83ec9db5396c812c/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.681479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eeed1eb0ed42228682d8259de27db5, user_id=381d81a2f2084dca83ec9db5396c812c, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.684168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.687176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:40.695593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1222/2451] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:19:40 2022] PUT /identity/v3/projects/84eeed1eb0ed42228682d8259de27db5/users/381d81a2f2084dca83ec9db5396c812c/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:40.706200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.706435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.706715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.732758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] MFA Rules not processed for user `381d81a2f2084dca83ec9db5396c812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:40.733959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:40.737984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:40.804767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1230/2452] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:40.816673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.818485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:40.876393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840729c2-26fd-4402-a1b8-94fe10236cb0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.880211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.880862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.881154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.881441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:40.890372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:40.892681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:40.902196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1223/2453] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:40.975044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:40.984950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3736a5-e1e8-42df-86bb-fbaa7d7701db None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:40.988740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaf50c-bb92-4047-bec8-c5df596648d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:40.989381 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaf50c-bb92-4047-bec8-c5df596648d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:40.989670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaf50c-bb92-4047-bec8-c5df596648d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:40.989953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaf50c-bb92-4047-bec8-c5df596648d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:41.049431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaf50c-bb92-4047-bec8-c5df596648d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:41.050878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaf50c-bb92-4047-bec8-c5df596648d1 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:41.059893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1231/2454] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:40 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:50.898043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=28 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:51.055772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=55 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:55.732185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:55.794843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce9da-4491-44e0-8e54-0bb4f4f893c2 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:55.800313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:55.801186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:55.801477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:55.801759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] PATH_INFO: `/v3/users/c9b2b1c0c9c741c791847e84aa3d9e54` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:55.802962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b2b1c0c9c741c791847e84aa3d9e54)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:55.804944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:55.850418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b2b1c0c9c741c791847e84aa3d9e54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:55.857791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b2b1c0c9c741c791847e84aa3d9e54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:55.858421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b2b1c0c9c741c791847e84aa3d9e54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:55.870987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b2b1c0c9c741c791847e84aa3d9e54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:55.871657 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b2b1c0c9c741c791847e84aa3d9e54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:55.885213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1224/2455] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:19:55 2022] DELETE /identity/v3/users/c9b2b1c0c9c741c791847e84aa3d9e54 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:19:55.889878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:55.890380 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:55.890487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:55.908732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:55.909953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:55.971623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1232/2456] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:55.981539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:55.982962 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:56.044156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840c31-a875-4074-8c36-97019ae85e1b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:56.048626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:56.049281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:56.049575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:56.049855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:56.059603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:56.061064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:56.071174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1225/2457] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:56.349735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:56.351215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:56.364702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083a24-2644-45bd-a209-7078ca2d42ff None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:56.369773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:56.370649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:56.370937 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:56.371254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] PATH_INFO: `/v3/projects/5c24fa7ca4ad444e80034fdab502fbf9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:56.372467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c24fa7ca4ad444e80034fdab502fbf9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:56.374616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:56.428774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c24fa7ca4ad444e80034fdab502fbf9', 'request_id': 'req-dbfc01fb-9912-4f3d-a9a2-79742e04d929'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.436747 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c24fa7ca4ad444e80034fdab502fbf9', 'request_id': 'req-dbfc01fb-9912-4f3d-a9a2-79742e04d929'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.443587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c24fa7ca4ad444e80034fdab502fbf9', 'request_id': 'req-dbfc01fb-9912-4f3d-a9a2-79742e04d929'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.454422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] The token cache is being invalidate because project 5c24fa7ca4ad444e80034fdab502fbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:19:56.454708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.455390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.456950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1233/2458] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:19:56 2022] DELETE /identity/v3/projects/5c24fa7ca4ad444e80034fdab502fbf9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:56.460928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:56.471813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0305d-4772-4920-817e-1dd1c5fc94f9 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:56.491501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:56.534729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:56.535634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:56.535920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:56.536196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] PATH_INFO: `/v3/users/381d81a2f2084dca83ec9db5396c812c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:56.537398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381d81a2f2084dca83ec9db5396c812c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:56.539366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:56.585358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381d81a2f2084dca83ec9db5396c812c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.593815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381d81a2f2084dca83ec9db5396c812c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.595308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381d81a2f2084dca83ec9db5396c812c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.607525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381d81a2f2084dca83ec9db5396c812c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.608190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85f21523-a6d4-4f48-9beb-9a7639698bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381d81a2f2084dca83ec9db5396c812c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:56.621868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1226/2459] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:19:56 2022] DELETE /identity/v3/users/381d81a2f2084dca83ec9db5396c812c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:56.904005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:56.905486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:56.919985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc01fb-9912-4f3d-a9a2-79742e04d929 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:56.980242 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:56.981109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:56.981395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:56.981674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] PATH_INFO: `/v3/projects/84eeed1eb0ed42228682d8259de27db5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:56.982856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84eeed1eb0ed42228682d8259de27db5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:56.984897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.014131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:57.036548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84eeed1eb0ed42228682d8259de27db5', 'request_id': 'req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:57.045346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84eeed1eb0ed42228682d8259de27db5', 'request_id': 'req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:57.052423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84eeed1eb0ed42228682d8259de27db5', 'request_id': 'req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:57.062736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] The token cache is being invalidate because project 84eeed1eb0ed42228682d8259de27db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:19:57.063022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:57.063881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0e2ecea0-0f6f-4b26-822c-87844a56d2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:19:57.065507 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1234/2460] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:19:56 2022] DELETE /identity/v3/projects/84eeed1eb0ed42228682d8259de27db5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:57.070372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.070849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.070956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.089017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:57.090619 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:57.151324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1227/2461] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:57.159608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.159901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.160181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.178997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:57.180226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:57.188313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1235/2462] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:57.192737 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.202672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f1c88-6776-46fa-90ca-8bd51c00a752 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.207651 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.208307 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.208603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.208885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.209615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:19:57.209929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.211573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.223762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1228/2463] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 15:19:57.227929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.237841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878df29-c1ba-473f-a328-a542f6dc8b21 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.242587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.243276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.243593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.243966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.244580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.246483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.272587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1236/2464] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:19:57.276545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.287387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f346-7b3d-45d8-9108-bab207dfdf8a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.314393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:57.352374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.353047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.353334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.353613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.354358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.356280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.378585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1229/2465] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:19:57.383043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.397463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195b0a7-0be3-4276-9efd-498f29080381 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.402276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.402931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.403253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.403532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.404257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.405856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.416910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1237/2466] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:19:57.420913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.431353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a2c1a-a76f-4935-834d-ee10cfe3eb05 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.436333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96bde-e888-4974-bca5-ddd23d420af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.437064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96bde-e888-4974-bca5-ddd23d420af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.437402 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96bde-e888-4974-bca5-ddd23d420af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.438315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96bde-e888-4974-bca5-ddd23d420af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.439394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc96bde-e888-4974-bca5-ddd23d420af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.441065 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc96bde-e888-4974-bca5-ddd23d420af7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.451459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1230/2467] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:19:57.456112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.466110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8911-11ec-48c4-a30e-01e18975cc5c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.470894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.471801 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.472093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.472377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] PATH_INFO: `/v3/projects/100a786f89044dab886573ce692d0648/users/be0beb5a21694435a407f80cb952c0f7/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.488468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100a786f89044dab886573ce692d0648, user_id=be0beb5a21694435a407f80cb952c0f7, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.491500 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.506334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1238/2468] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:19:57 2022] PUT /identity/v3/projects/100a786f89044dab886573ce692d0648/users/be0beb5a21694435a407f80cb952c0f7/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:57.518227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.518523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.518809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.544969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] MFA Rules not processed for user `be0beb5a21694435a407f80cb952c0f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:57.546094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:57.614251 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1231/2469] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:57.618706 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.682026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6f97b-0465-4f67-a63f-7e779f916fb7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.686841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.687528 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.688432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.688785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.689490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.691431 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.716526 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1239/2470] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:19:57.721139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.731862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eb1f5-7f82-40cb-87ae-c9bedd80e32c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.789364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.790038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.790328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.790615 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.791455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.793441 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.814026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1232/2471] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:19:57 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:19:57.817932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.828220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c33574-f54d-4201-bc31-d8d7d6e70575 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.834516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.835215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.835504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.835781 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.836580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.838111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.849302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1240/2472] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:19:57.853549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.864376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871261f7-8f75-408f-b415-bb7cdacee645 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.869559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.870436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.870720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.871000 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] PATH_INFO: `/v3/projects/94bd9c52255540b2afcf221fa9a68179/users/ac81e0765e00455c91754e2a083235bd/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.885912 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bd9c52255540b2afcf221fa9a68179, user_id=ac81e0765e00455c91754e2a083235bd, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.888616 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.902941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1233/2473] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:19:57 2022] PUT /identity/v3/projects/94bd9c52255540b2afcf221fa9a68179/users/ac81e0765e00455c91754e2a083235bd/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:57.908254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:57.918999 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5462b-acc2-4a1c-9375-7ba9e4aeb40f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:57.940122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:57.979415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d223de0-d32e-4440-a15b-027d21231f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:57.980082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d223de0-d32e-4440-a15b-027d21231f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:57.980366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d223de0-d32e-4440-a15b-027d21231f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:57.980757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d223de0-d32e-4440-a15b-027d21231f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:57.981479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d223de0-d32e-4440-a15b-027d21231f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:57.983074 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d223de0-d32e-4440-a15b-027d21231f22 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:57.993034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1241/2474] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:19:57.997203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:58.003355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:58.009081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca685c6-fe3e-4ed8-9026-b89d981ace8d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:58.014499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:58.015413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:58.015703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:58.016712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] PATH_INFO: `/v3/projects/94bd9c52255540b2afcf221fa9a68179/users/ac81e0765e00455c91754e2a083235bd/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:58.018790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bd9c52255540b2afcf221fa9a68179, user_id=ac81e0765e00455c91754e2a083235bd, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:58.021533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:58.032351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1234/2475] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:19:57 2022] PUT /identity/v3/projects/94bd9c52255540b2afcf221fa9a68179/users/ac81e0765e00455c91754e2a083235bd/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:19:58.042470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:58.042760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:58.043037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:58.070146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] MFA Rules not processed for user `ac81e0765e00455c91754e2a083235bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:19:58.071330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:58.139851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1242/2476] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:19:58.151467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:58.153264 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:19:58.213757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624082f-c906-45ac-92d8-7766aebc872e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:58.217714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:58.218358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:58.218645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:58.218941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:58.228174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:58.229611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:58.239144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1235/2477] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:19:58.323654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:19:58.334005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d69e-29c2-4c17-9fc4-123cd9768a6d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:19:58.337880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc37b24-8027-4ed9-8bae-741ce5d5adf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:19:58.338649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37b24-8027-4ed9-8bae-741ce5d5adf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:19:58.338934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37b24-8027-4ed9-8bae-741ce5d5adf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:19:58.339272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37b24-8027-4ed9-8bae-741ce5d5adf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:19:58.397289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc37b24-8027-4ed9-8bae-741ce5d5adf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:19:58.398725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc37b24-8027-4ed9-8bae-741ce5d5adf4 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:19:58.408457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1243/2478] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:19:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:02.431131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:02.493044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7807d61-ceb5-4893-8d9d-1fe7d7e3ca79 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:02.497803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:02.498676 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:02.498968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:02.499280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] PATH_INFO: `/v3/users/be0beb5a21694435a407f80cb952c0f7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:02.500867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0beb5a21694435a407f80cb952c0f7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:02.502798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:02.550621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0beb5a21694435a407f80cb952c0f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:02.558107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0beb5a21694435a407f80cb952c0f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:02.558734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0beb5a21694435a407f80cb952c0f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:02.570756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0beb5a21694435a407f80cb952c0f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:02.571479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0beb5a21694435a407f80cb952c0f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:02.583801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1236/2479] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:02 2022] DELETE /identity/v3/users/be0beb5a21694435a407f80cb952c0f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:02.588293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:02.588769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:02.588871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:02.607372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:02.608580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:02.649987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:02.670634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1244/2480] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:02.681017 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:02.682432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:02.696276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:02.745014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf330-1843-4c04-9375-f6263abb0b19 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:02.748666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:02.749308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:02.749593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:02.749898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:02.759287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:02.760780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:02.771256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1237/2481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:03.046058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:03.047751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:03.064436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c06c-af82-4abd-9c58-2010cb27c9e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:03.069465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:03.070482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.070644 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.071067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] PATH_INFO: `/v3/projects/100a786f89044dab886573ce692d0648` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.072236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100a786f89044dab886573ce692d0648)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:03.074153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:03.124345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100a786f89044dab886573ce692d0648', 'request_id': 'req-10802cb6-bda1-4d71-af8b-85f2d4b3d509'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.133267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100a786f89044dab886573ce692d0648', 'request_id': 'req-10802cb6-bda1-4d71-af8b-85f2d4b3d509'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.139564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100a786f89044dab886573ce692d0648', 'request_id': 'req-10802cb6-bda1-4d71-af8b-85f2d4b3d509'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.151081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] The token cache is being invalidate because project 100a786f89044dab886573ce692d0648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:03.151406 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.152034 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.153578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1245/2482] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:03 2022] DELETE /identity/v3/projects/100a786f89044dab886573ce692d0648 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:03.158191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:03.167757 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21c3c-5d06-4699-871b-edf13c00b1c2 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:03.228715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:03.229599 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.229888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.230165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] PATH_INFO: `/v3/users/ac81e0765e00455c91754e2a083235bd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.231397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac81e0765e00455c91754e2a083235bd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:03.233361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:03.282809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac81e0765e00455c91754e2a083235bd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.289604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac81e0765e00455c91754e2a083235bd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.290222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac81e0765e00455c91754e2a083235bd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.302751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac81e0765e00455c91754e2a083235bd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.303490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4217c876-1ca4-449c-99c2-639e7bcdb58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac81e0765e00455c91754e2a083235bd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.316173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1238/2483] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:03 2022] DELETE /identity/v3/users/ac81e0765e00455c91754e2a083235bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:03.583282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:03.584701 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:03.598981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10802cb6-bda1-4d71-af8b-85f2d4b3d509 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:03.658498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:03.659399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.659736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.659977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] PATH_INFO: `/v3/projects/94bd9c52255540b2afcf221fa9a68179` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.661153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bd9c52255540b2afcf221fa9a68179)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:03.663072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:03.712151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bd9c52255540b2afcf221fa9a68179', 'request_id': 'req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.719445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bd9c52255540b2afcf221fa9a68179', 'request_id': 'req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.725827 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bd9c52255540b2afcf221fa9a68179', 'request_id': 'req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.732236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:03.737942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] The token cache is being invalidate because project 94bd9c52255540b2afcf221fa9a68179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:03.738464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.739574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d1a34b92-e82c-4bb6-98ac-396e5f1ba37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:03.741209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1246/2484] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:03 2022] DELETE /identity/v3/projects/94bd9c52255540b2afcf221fa9a68179 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:03.746137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.746618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.746730 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.764628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:03.765876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:03.795276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:03.829276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1239/2485] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:03.838387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.838679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.838958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.857198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:03.858382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:03.866881 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1247/2486] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:20:03.870990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:03.881286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf83e9-0a2e-4d27-9c66-44d4d494c757 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:03.885862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:03.886511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.886795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.887072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.887835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:20:03.888125 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:03.889725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:03.901692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1240/2487] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:20:03.906001 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:03.916180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718532b-bd3d-4d82-956a-793edd173524 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:03.920865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:03.921515 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:03.921799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:03.922716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:03.923567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:03.925471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:03.950654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1248/2488] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:03 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:20:03.955286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:03.966740 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c7978-bb52-433a-b8d4-c5687214b3c1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.024040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.024718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.024998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.025278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.025969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.027942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.050051 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1241/2489] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:03 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:04.054141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.065257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b08b4-a5f6-4732-9bdd-745434d41701 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.069952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.070607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.070894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.071316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.072049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.073704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.084854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1249/2490] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:04.088787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.099048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0212f-12e4-4936-9574-a8d05e1b240b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.103802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58eff-952a-4546-bdb9-aa27d172f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.104501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58eff-952a-4546-bdb9-aa27d172f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.104794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58eff-952a-4546-bdb9-aa27d172f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.105073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58eff-952a-4546-bdb9-aa27d172f7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.105809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b58eff-952a-4546-bdb9-aa27d172f7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.107506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b58eff-952a-4546-bdb9-aa27d172f7b0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.118183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1242/2491] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:04.122680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.133325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1c3e-ed44-488b-8634-860ab22e41f5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.138047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.138957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.139291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.139573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] PATH_INFO: `/v3/projects/c94d8c7071ba4e46abb58cf3af5eeafb/users/62b3df5d4933427489110cf15ab30e70/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.154805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94d8c7071ba4e46abb58cf3af5eeafb, user_id=62b3df5d4933427489110cf15ab30e70, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.157548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.170258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1250/2492] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:04 2022] PUT /identity/v3/projects/c94d8c7071ba4e46abb58cf3af5eeafb/users/62b3df5d4933427489110cf15ab30e70/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:04.180629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.180929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.181207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.209847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] MFA Rules not processed for user `62b3df5d4933427489110cf15ab30e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:04.211121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:04.275234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1243/2493] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:04.279763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.342270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0eb0a-380f-4bcd-a26b-b913e6435202 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.347080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.347764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.348055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.348338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.349045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.350962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.377042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1251/2494] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:04 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:04.381134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.392183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300697f5-e4bf-49d1-903f-393d5bc2cbe4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.418552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:04.451920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.452522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.452813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.453096 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.453871 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.455913 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.475852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1244/2495] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:04 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:04.479876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.491195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b8ea-67ab-4378-95c5-37c8a19c7bd9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.496088 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.496846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.497146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.497408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.498289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.499953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.511993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1252/2496] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:04.516084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.526540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf940-45b7-466f-afbe-5e71f28ff51d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.531190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9ffcc-9931-41d1-8895-7e0e4419630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.532120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9ffcc-9931-41d1-8895-7e0e4419630b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.532411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9ffcc-9931-41d1-8895-7e0e4419630b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.532691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9ffcc-9931-41d1-8895-7e0e4419630b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.533424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9ffcc-9931-41d1-8895-7e0e4419630b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.535059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9ffcc-9931-41d1-8895-7e0e4419630b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.544967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1245/2497] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:04.549509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.559565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87008ab-5fa1-4974-add9-ef8b608064e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.564847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.565721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.566010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.566292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] PATH_INFO: `/v3/projects/d83a7ee6aeaf4b618b4b52bb7672eeb6/users/60c9f8b475bf4897bb8a5f3df7bd6b43/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.580816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83a7ee6aeaf4b618b4b52bb7672eeb6, user_id=60c9f8b475bf4897bb8a5f3df7bd6b43, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.583518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.596634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1253/2498] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:04 2022] PUT /identity/v3/projects/d83a7ee6aeaf4b618b4b52bb7672eeb6/users/60c9f8b475bf4897bb8a5f3df7bd6b43/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:04.607276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.607576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.607857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.636194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] MFA Rules not processed for user `60c9f8b475bf4897bb8a5f3df7bd6b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:04.637436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:04.703266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1246/2499] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:04.707778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.754702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:04.772539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dffb41-71c5-4335-a449-770b1d036a78 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.777245 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.777897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.778182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.778461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.779183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.781085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.810620 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1254/2500] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:04 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:04.811787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.822824 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5906-1b82-485c-82f5-94887a210eb4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.879266 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.879938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.880228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.880508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.881194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.883156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.916144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1247/2501] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:04 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:04.917307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.928207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ffaa-ad70-4aa3-8600-ec730508a130 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.932899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.933555 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.933841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.934119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.934839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.936471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.946836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1255/2502] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:20:04.951047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:04.961147 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134e36-d318-4f96-b8c0-47a25b57184b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:04.965640 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:04.966511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:04.966793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:04.967068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] PATH_INFO: `/v3/projects/a9e8f37a685643e8bf94b7c766f58c31/users/7039a433554847a585666bb17a413808/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:04.982041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e8f37a685643e8bf94b7c766f58c31, user_id=7039a433554847a585666bb17a413808, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:04.985511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:04.997993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1248/2503] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:04 2022] PUT /identity/v3/projects/a9e8f37a685643e8bf94b7c766f58c31/users/7039a433554847a585666bb17a413808/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:20:05.001843 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:05.012011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df08d1-4551-4e15-975c-0570f328d51e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:05.070048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0313-b8ee-4432-b4cf-4a09c3db672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:05.070715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0313-b8ee-4432-b4cf-4a09c3db672a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:05.070997 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0313-b8ee-4432-b4cf-4a09c3db672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:05.071303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0313-b8ee-4432-b4cf-4a09c3db672a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:05.072018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0313-b8ee-4432-b4cf-4a09c3db672a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:05.073634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0313-b8ee-4432-b4cf-4a09c3db672a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:05.084335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1256/2504] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:05.088472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:05.094700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:05.101197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c0fd4-2eeb-4ab7-b553-39bc3f5b2cf2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:05.106467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:05.107381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:05.107668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:05.107948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] PATH_INFO: `/v3/projects/a9e8f37a685643e8bf94b7c766f58c31/users/7039a433554847a585666bb17a413808/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:05.110186 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e8f37a685643e8bf94b7c766f58c31, user_id=7039a433554847a585666bb17a413808, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:05.112789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:05.123176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1249/2505] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:05 2022] PUT /identity/v3/projects/a9e8f37a685643e8bf94b7c766f58c31/users/7039a433554847a585666bb17a413808/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:05.134266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:05.134566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:05.134853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:05.163756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] MFA Rules not processed for user `7039a433554847a585666bb17a413808`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:05.164972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:05.234606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1257/2506] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:05.246540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:05.248666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:05.309044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40421b-af29-4741-86ec-91be07991d7a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:05.313192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:05.313843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:05.314127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:05.314405 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:05.323434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:05.324859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:05.335484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1250/2507] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:05.378721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:05.380147 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:05.392818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b47ad-1582-4b66-bd94-f9d124da7dfc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:05.396479 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd46d51-3319-489d-9f6e-6c4982405e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:05.397116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46d51-3319-489d-9f6e-6c4982405e32 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:05.397408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46d51-3319-489d-9f6e-6c4982405e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:05.397690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46d51-3319-489d-9f6e-6c4982405e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:05.436865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:05.459023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46d51-3319-489d-9f6e-6c4982405e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:05.460540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46d51-3319-489d-9f6e-6c4982405e32 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:05.470066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1258/2508] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:08.319825 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:08.382337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb4d91-d442-49e8-b112-830ad1c9f2c4 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:08.386961 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:08.387856 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:08.388149 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:08.388431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] PATH_INFO: `/v3/users/62b3df5d4933427489110cf15ab30e70` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:08.389629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b3df5d4933427489110cf15ab30e70)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:08.392383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:08.438102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b3df5d4933427489110cf15ab30e70'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:08.446837 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b3df5d4933427489110cf15ab30e70'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:08.447501 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b3df5d4933427489110cf15ab30e70'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:08.461524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b3df5d4933427489110cf15ab30e70'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:08.462181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b3df5d4933427489110cf15ab30e70'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:08.474585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1251/2509] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:08 2022] DELETE /identity/v3/users/62b3df5d4933427489110cf15ab30e70 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:08.479051 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:08.479557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:08.479664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:08.497649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:08.498854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:08.559618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1259/2510] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:08.569636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:08.571047 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:08.585590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:08.632295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb78fd-6763-4e4a-a324-52bc167efa16 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:08.636016 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:08.636663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:08.636951 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:08.637234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:08.647069 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:08.648574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:08.658192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1252/2511] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:08.934583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:08.936140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:08.950073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60f45a-f718-492d-aee4-ec8dafc6c2d0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:08.956223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:08.957688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:08.958153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:08.958445 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] PATH_INFO: `/v3/projects/c94d8c7071ba4e46abb58cf3af5eeafb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:08.959715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94d8c7071ba4e46abb58cf3af5eeafb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:08.961682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:09.010603 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94d8c7071ba4e46abb58cf3af5eeafb', 'request_id': 'req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.018639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94d8c7071ba4e46abb58cf3af5eeafb', 'request_id': 'req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.025046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94d8c7071ba4e46abb58cf3af5eeafb', 'request_id': 'req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.036753 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] The token cache is being invalidate because project c94d8c7071ba4e46abb58cf3af5eeafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:09.037117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.037921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.039739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1260/2512] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:08 2022] DELETE /identity/v3/projects/c94d8c7071ba4e46abb58cf3af5eeafb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:09.043844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:09.062239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933401-f786-4124-a9cb-e3292b888a50 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:09.120152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:09.121031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:09.121321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:09.121605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] PATH_INFO: `/v3/users/60c9f8b475bf4897bb8a5f3df7bd6b43` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:09.122792 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c9f8b475bf4897bb8a5f3df7bd6b43)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:09.124781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:09.169879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c9f8b475bf4897bb8a5f3df7bd6b43'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.177977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c9f8b475bf4897bb8a5f3df7bd6b43'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.178585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c9f8b475bf4897bb8a5f3df7bd6b43'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.190636 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c9f8b475bf4897bb8a5f3df7bd6b43'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.191357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c9f8b475bf4897bb8a5f3df7bd6b43'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.203854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1253/2513] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:09 2022] DELETE /identity/v3/users/60c9f8b475bf4897bb8a5f3df7bd6b43 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:20:09.484972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:09.486408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:09.500450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac29bb-8d4b-4fd6-8d87-d5f00fb81467 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:09.560662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:09.561524 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:09.561805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:09.562084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] PATH_INFO: `/v3/projects/d83a7ee6aeaf4b618b4b52bb7672eeb6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:09.563817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83a7ee6aeaf4b618b4b52bb7672eeb6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:09.565642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:09.567927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:09.614649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83a7ee6aeaf4b618b4b52bb7672eeb6', 'request_id': 'req-29187e23-d710-473f-8a77-276dc23aa3fa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.621784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83a7ee6aeaf4b618b4b52bb7672eeb6', 'request_id': 'req-29187e23-d710-473f-8a77-276dc23aa3fa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.628077 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83a7ee6aeaf4b618b4b52bb7672eeb6', 'request_id': 'req-29187e23-d710-473f-8a77-276dc23aa3fa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.638290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] The token cache is being invalidate because project d83a7ee6aeaf4b618b4b52bb7672eeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:09.638580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.639256 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.641646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1261/2514] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:09 2022] DELETE /identity/v3/projects/d83a7ee6aeaf4b618b4b52bb7672eeb6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:20:09.646143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:09.647593 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:09.661200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61ba9-cd51-4f8d-b751-a3400a48c854 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:09.690822 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:09.719556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:09.720430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:09.720715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:09.720991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] PATH_INFO: `/v3/users/7039a433554847a585666bb17a413808` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:09.722181 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7039a433554847a585666bb17a413808)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:09.724158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:09.773559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7039a433554847a585666bb17a413808'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.780874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7039a433554847a585666bb17a413808'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.782605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7039a433554847a585666bb17a413808'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.794734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7039a433554847a585666bb17a413808'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.795396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-019aeaa4-0949-434e-b45a-dfeb0e68fe31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7039a433554847a585666bb17a413808'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:09.808117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1254/2515] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:09 2022] DELETE /identity/v3/users/7039a433554847a585666bb17a413808 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:10.090710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.092464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:10.107905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29187e23-d710-473f-8a77-276dc23aa3fa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.167008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.167965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.168251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.168534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] PATH_INFO: `/v3/projects/a9e8f37a685643e8bf94b7c766f58c31` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.169722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e8f37a685643e8bf94b7c766f58c31)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.171704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.219837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e8f37a685643e8bf94b7c766f58c31', 'request_id': 'req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:10.227230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e8f37a685643e8bf94b7c766f58c31', 'request_id': 'req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:10.233636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e8f37a685643e8bf94b7c766f58c31', 'request_id': 'req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:10.245564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] The token cache is being invalidate because project a9e8f37a685643e8bf94b7c766f58c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:10.245859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:10.246554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef881d4a-a9ea-4f08-9c76-5c6ae85ab23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:10.248212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1262/2516] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:10 2022] DELETE /identity/v3/projects/a9e8f37a685643e8bf94b7c766f58c31 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:10.254043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.254354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.254621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.273911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:10.275137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:10.333866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1255/2517] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:10.341988 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.342288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.342574 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.362192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:10.363444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:10.371428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1263/2518] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:10.376203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.386064 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5d30-96ac-4646-b1f2-c7c9f49db4ad None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.391562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.392355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.392639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.392917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.393641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:20:10.394002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.395654 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.407966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1256/2519] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:20:10.412562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.422208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb2f61-0445-41ea-ac78-fc4ad35d1697 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.427005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.427689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.427978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.428262 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.428953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.430853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.444061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:10.459773 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1264/2520] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:10.462540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.474139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926b3f-872f-40d9-9ed8-e13b056e21b1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.512724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:10.534870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.535594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.535922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.536235 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.536950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.538922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.558520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1257/2521] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:20:10.563215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.573537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2dfc5-2c36-4c4c-a44b-604c4d21c7af admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.579384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.580162 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.580450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.580728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.581475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.583064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.593527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1265/2522] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:10.597597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.607419 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41551e83-4706-474c-9f91-09c87499f4b9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.613095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaaca2-ab28-4330-90f7-b4729df285a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.613746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaaca2-ab28-4330-90f7-b4729df285a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.614031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaaca2-ab28-4330-90f7-b4729df285a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.614308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaaca2-ab28-4330-90f7-b4729df285a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.615026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaaca2-ab28-4330-90f7-b4729df285a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.616648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaaca2-ab28-4330-90f7-b4729df285a5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.627162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1258/2523] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:10.630900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.641815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518aa3-ff33-4ec1-a728-d6e5fd592fc3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.646642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.647572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.647865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.648145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] PATH_INFO: `/v3/projects/6542f9f77dba4df2ac58e052faa9b896/users/f6c8f3cae52a4a4ab1776f14ac3c125f/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.664668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6542f9f77dba4df2ac58e052faa9b896, user_id=f6c8f3cae52a4a4ab1776f14ac3c125f, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.667353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.680320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1266/2524] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:10 2022] PUT /identity/v3/projects/6542f9f77dba4df2ac58e052faa9b896/users/f6c8f3cae52a4a4ab1776f14ac3c125f/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:10.693603 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.694137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.694256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.723040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] MFA Rules not processed for user `f6c8f3cae52a4a4ab1776f14ac3c125f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:10.724279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:10.788579 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1259/2525] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:10.793036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.855228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf817f9-f8e0-4d18-81d8-d77d62182bae admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.860972 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.861636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.861921 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.862200 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.862899 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.864848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.889831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1267/2526] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:10.894313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:10.905128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad2c5-19bc-47c5-bea6-fe96f41bbb3e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:10.963853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:10.964522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:10.964811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:10.965091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:10.965773 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:10.967758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:10.989930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1260/2527] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:10 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:10.994478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:11.004970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d93d7-31c9-415c-9d9a-2e9301e86ea0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:11.009987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:11.010647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.010932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.011257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.011979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:11.013576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:11.025474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1268/2528] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:11.029575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:11.040530 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26fbbc-382c-49fe-8e2e-e7064c41512b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:11.045353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:11.046236 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.046522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.046838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] PATH_INFO: `/v3/projects/47027464600f4c98a60caf4b4c625965/users/0cad2079e50f41398cbe3ba239f87af1/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.061847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47027464600f4c98a60caf4b4c625965, user_id=0cad2079e50f41398cbe3ba239f87af1, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:11.064790 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:11.077578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1261/2529] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:11 2022] PUT /identity/v3/projects/47027464600f4c98a60caf4b4c625965/users/0cad2079e50f41398cbe3ba239f87af1/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:11.082546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:11.092785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab0d93-6cb2-42f7-992b-a778092dd416 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:11.151476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b3d85-62c8-45d3-8d20-8722c878d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:11.152150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3d85-62c8-45d3-8d20-8722c878d645 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.152439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3d85-62c8-45d3-8d20-8722c878d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.152716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3d85-62c8-45d3-8d20-8722c878d645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.153438 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3d85-62c8-45d3-8d20-8722c878d645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:11.155039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3d85-62c8-45d3-8d20-8722c878d645 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:11.165044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1269/2530] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:20:11.169160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:11.180523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76dce-19d1-4fce-9874-7a093d86906e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:11.185313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:11.186187 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.186477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.186758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] PATH_INFO: `/v3/projects/47027464600f4c98a60caf4b4c625965/users/0cad2079e50f41398cbe3ba239f87af1/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.189470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=47027464600f4c98a60caf4b4c625965, user_id=0cad2079e50f41398cbe3ba239f87af1, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:11.192559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:11.199127 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:11.205217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1262/2531] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:11 2022] PUT /identity/v3/projects/47027464600f4c98a60caf4b4c625965/users/0cad2079e50f41398cbe3ba239f87af1/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:11.215332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.215627 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.215906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.242940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] MFA Rules not processed for user `0cad2079e50f41398cbe3ba239f87af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:11.244184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:11.261566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:11.315311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1270/2532] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:11.326133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:11.327861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:11.386237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f1e7e-b6bc-4a73-b285-3534f9acd2ff admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:11.389768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538ca32-d03e-43b7-a89a-c43c67b99a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:11.390407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ca32-d03e-43b7-a89a-c43c67b99a10 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.391455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ca32-d03e-43b7-a89a-c43c67b99a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.391746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ca32-d03e-43b7-a89a-c43c67b99a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.400978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538ca32-d03e-43b7-a89a-c43c67b99a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:11.402408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538ca32-d03e-43b7-a89a-c43c67b99a10 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:11.412726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1263/2533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:11.768175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:11.830718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163e31f-c9b6-452e-bf1f-5c224988c60c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:11.835323 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:11.836206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.836488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.836767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] PATH_INFO: `/v3/users/f6c8f3cae52a4a4ab1776f14ac3c125f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.838003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c8f3cae52a4a4ab1776f14ac3c125f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:11.839971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:11.885741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c8f3cae52a4a4ab1776f14ac3c125f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:11.886388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c8f3cae52a4a4ab1776f14ac3c125f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:11.894047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c8f3cae52a4a4ab1776f14ac3c125f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:11.894622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c8f3cae52a4a4ab1776f14ac3c125f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:11.901992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c8f3cae52a4a4ab1776f14ac3c125f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:11.921030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1271/2534] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:11 2022] DELETE /identity/v3/users/f6c8f3cae52a4a4ab1776f14ac3c125f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:11.926025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:11.926525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:11.926626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:11.944708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:11.945933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:12.003835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1264/2535] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:12.013384 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:12.014793 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:12.052612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:12.076898 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838522e-4703-4226-88e8-e879336a466f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:12.081045 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:12.081686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:12.081969 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:12.082244 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:12.091236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:12.092675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:12.102531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1272/2536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:12.369435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:12.370944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:12.384931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d2021-ae7c-47d7-a087-b5ec19c0c2a5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:12.389719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:12.390660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:12.391867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:12.392152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] PATH_INFO: `/v3/projects/6542f9f77dba4df2ac58e052faa9b896` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:12.393992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6542f9f77dba4df2ac58e052faa9b896)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:12.395979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:12.444313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6542f9f77dba4df2ac58e052faa9b896', 'request_id': 'req-037a160c-e21d-496b-9ea6-00843fcba525'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.450354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6542f9f77dba4df2ac58e052faa9b896', 'request_id': 'req-037a160c-e21d-496b-9ea6-00843fcba525'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.456322 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6542f9f77dba4df2ac58e052faa9b896', 'request_id': 'req-037a160c-e21d-496b-9ea6-00843fcba525'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.469731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] The token cache is being invalidate because project 6542f9f77dba4df2ac58e052faa9b896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:12.470019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.470652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.472252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1265/2537] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:12 2022] DELETE /identity/v3/projects/6542f9f77dba4df2ac58e052faa9b896 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:12.476184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:12.487236 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848d37-5032-4232-8044-e6680f8e1e20 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:12.545028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:12.545903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:12.546193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:12.546478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] PATH_INFO: `/v3/users/0cad2079e50f41398cbe3ba239f87af1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:12.547819 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cad2079e50f41398cbe3ba239f87af1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:12.549823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:12.597289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cad2079e50f41398cbe3ba239f87af1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.597941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cad2079e50f41398cbe3ba239f87af1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.605022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cad2079e50f41398cbe3ba239f87af1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.605692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cad2079e50f41398cbe3ba239f87af1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.612724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-52a9e5ac-3a51-4758-9895-4b4a961939af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cad2079e50f41398cbe3ba239f87af1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:12.630268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1273/2538] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:12 2022] DELETE /identity/v3/users/0cad2079e50f41398cbe3ba239f87af1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:20:12.903195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:12.904755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:12.922487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a160c-e21d-496b-9ea6-00843fcba525 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:12.949370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:12.983604 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:12.985063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:12.985356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:12.985639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] PATH_INFO: `/v3/projects/47027464600f4c98a60caf4b4c625965` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:12.986843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47027464600f4c98a60caf4b4c625965)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:12.988817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.049970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47027464600f4c98a60caf4b4c625965', 'request_id': 'req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:13.056170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47027464600f4c98a60caf4b4c625965', 'request_id': 'req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:13.061787 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47027464600f4c98a60caf4b4c625965', 'request_id': 'req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:13.074675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] The token cache is being invalidate because project 47027464600f4c98a60caf4b4c625965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:13.074964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:13.075611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0e5244f6-6f7c-4c30-bd83-73e4a426edb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:13.077195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1266/2539] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:12 2022] DELETE /identity/v3/projects/47027464600f4c98a60caf4b4c625965 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:13.083008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.083511 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.083776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.103797 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:13.105173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:13.158325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:13.172635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1274/2540] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:13.180864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.181162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.181449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.200481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:13.201948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:13.210165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1267/2541] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:13.214367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.225009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4adf-d800-4c93-a047-bc6e9546f9dc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.229583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.230231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.230513 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.230788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.231552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:20:13.231857 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.233440 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.245606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1275/2542] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:20:13.250527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.259974 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e360b-86e5-4240-9fb5-9ec37d733100 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.264811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.265498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.267139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.267430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.268265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.270246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.298222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1268/2543] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:13 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:13.300705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.311734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba6ad-c8e9-4b2d-822e-e60ba0e495b5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.374324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.375694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.376032 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.376312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.377012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.378964 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.399155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1276/2544] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:13 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:13.403399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.414154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c084-db9b-45bf-9fa5-fcc9ed8a5363 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.418734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.419428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.419718 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.419998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.420752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.422953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.433269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1269/2545] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:13.437971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.447933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a75d2-526a-4f65-a5e2-5ce0c26e9455 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.452587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eba01-1964-4942-b9ab-abd36e2c2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.453541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eba01-1964-4942-b9ab-abd36e2c2b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.453541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eba01-1964-4942-b9ab-abd36e2c2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.453836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eba01-1964-4942-b9ab-abd36e2c2b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.454560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eba01-1964-4942-b9ab-abd36e2c2b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.456183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eba01-1964-4942-b9ab-abd36e2c2b88 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.466003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1277/2546] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:13.470293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.480177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7179d-3626-4c4f-982b-6df3f6df71dd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.485879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.486755 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.487038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.487351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] PATH_INFO: `/v3/projects/76ec906819044d9aaa3dfd600cc1178b/users/7564265e3f59461fa0937fa0f6581c8a/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.503584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ec906819044d9aaa3dfd600cc1178b, user_id=7564265e3f59461fa0937fa0f6581c8a, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.506296 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.520013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1270/2547] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:13 2022] PUT /identity/v3/projects/76ec906819044d9aaa3dfd600cc1178b/users/7564265e3f59461fa0937fa0f6581c8a/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:13.532010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.532334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.532615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.560092 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] MFA Rules not processed for user `7564265e3f59461fa0937fa0f6581c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:13.561322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:13.627073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1278/2548] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:13.638869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:13.641459 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:13.699332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779aba-0adb-4e77-becb-6b33ea969e2b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:13.702943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:13.704189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:13.704476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:13.704751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:13.711300 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:13.713668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:13.716029 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:13.726342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1271/2549] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:16.307033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:16.308681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:16.365902 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:16.388731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36e694-d559-4c33-aabd-9ae937e22307 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:16.395367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:16.396056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:16.396345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:16.396624 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:16.398401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:16.479663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:16.481261 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:16.499635 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1279/2550] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:23.725180 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:26.497011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=46 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:30.466883 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:30.469719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:30.561739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd05ed5-fdf8-4629-9457-c384152d3c51 service glance] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:30.569971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:30.570954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:30.571276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:30.571560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:30.574752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:30.590999 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:30.594612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b870514-02da-4603-83e1-c774b785f660 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:30.607997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1272/2551] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:36.324189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:36.325676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:36.431316 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174dc2-3992-49b7-afd2-d07ab8a1fcf2 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:36.435075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:36.435757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:36.436044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:36.436325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:36.438680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:36.526166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:36.527652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:36.547068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1280/2552] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:36.705131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:36.705716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:36.705826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:36.724213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] MFA Rules not processed for user `e55884035fd3441583ece37dd8eb9248`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:36.725398 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:36.782591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1273/2553] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:37.312734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:37.322602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a1de-d12b-45f2-b518-fcb415d69213 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:37.329525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:37.330462 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:37.330601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:37.330816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:37.333136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:37.344063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:37.345552 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:37.354164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1281/2554] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:40.053644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:40.055131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:40.069661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff33d-1817-4988-a16b-75afcdee749b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:40.074291 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:40.075200 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.075491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.075768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] PATH_INFO: `/v3/users/1421fb674ae04d6ea9ae342b73ce8115` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.076985 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1421fb674ae04d6ea9ae342b73ce8115)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:40.079079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:40.137597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1421fb674ae04d6ea9ae342b73ce8115'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.150217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1421fb674ae04d6ea9ae342b73ce8115'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.151179 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1421fb674ae04d6ea9ae342b73ce8115'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.168175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1421fb674ae04d6ea9ae342b73ce8115'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.169379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ae20aa64-da1b-488e-ad35-5ce94b6c1561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1421fb674ae04d6ea9ae342b73ce8115'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.188608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1274/2555] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:20:40 2022] DELETE /identity/v3/users/1421fb674ae04d6ea9ae342b73ce8115 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:40.392171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:40.409875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383c15-6c71-425f-95fd-5e0ec54d0b2f service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:40.454845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:40.508897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:40.510073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.510364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.510641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] PATH_INFO: `/v3/projects/196700c560cd4d6e9461ec9571facf39` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.511897 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196700c560cd4d6e9461ec9571facf39)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:40.514510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:40.574368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196700c560cd4d6e9461ec9571facf39', 'request_id': 'req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.585531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196700c560cd4d6e9461ec9571facf39', 'request_id': 'req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.599232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196700c560cd4d6e9461ec9571facf39', 'request_id': 'req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.611283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] The token cache is being invalidate because project 196700c560cd4d6e9461ec9571facf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:20:40.611583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.612251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c43d2b6-66cf-4cd7-8ea2-7c0f67719171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:20:40.614475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1282/2556] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:20:40 2022] DELETE /identity/v3/projects/196700c560cd4d6e9461ec9571facf39 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:40.618891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.619233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.620275 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.644461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:40.695354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:40.696796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:40.770193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1275/2557] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:40.771967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.772263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.772550 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.796061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:40.797436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:40.809348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1283/2558] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:40.814617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:40.825911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464d222-5ba4-45e7-adc7-d681d5b97cba None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:40.831423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:40.832157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.832448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.832739 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.833493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:20:40.833806 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:40.835516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:40.851364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1276/2559] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:20:40.856046 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:40.865893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25c065-d79c-4bb6-955c-076164b88cc8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:40.870815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:40.871540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.871834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.872116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.872824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:40.875383 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:40.909399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1284/2560] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:40 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:20:40.913946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:40.926500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3912c-50ee-4d8b-8dcc-438f769ea94e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:40.991576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:40.992260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:40.992550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:40.992832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:40.993535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:40.995545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.019001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1277/2561] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:40 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:20:41.020235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.032665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d442f-1caf-46ac-8aa6-53706a3e4b4d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.038367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.039506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.040008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.040325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.042405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.044068 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.056159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1285/2562] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:20:41.059945 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.071490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb627-5911-4875-a37a-d09ec667b497 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.079375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c465-f2d5-455f-9ec0-c56d01ef0eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.081026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c465-f2d5-455f-9ec0-c56d01ef0eee admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.081319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c465-f2d5-455f-9ec0-c56d01ef0eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.081600 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c465-f2d5-455f-9ec0-c56d01ef0eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.082380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c465-f2d5-455f-9ec0-c56d01ef0eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.084037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c465-f2d5-455f-9ec0-c56d01ef0eee admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.096896 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1278/2563] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:20:41.101265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.112734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c45ce-fa69-46c3-932f-902475e32677 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.117468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.118510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.118862 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.119272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] PATH_INFO: `/v3/projects/8a614ae0a9a8463aa0fa3ece928d37d4/users/7ceeb4bf8cfa45498119db4ea4266481/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.136568 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a614ae0a9a8463aa0fa3ece928d37d4, user_id=7ceeb4bf8cfa45498119db4ea4266481, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.139325 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.159148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1286/2564] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:41 2022] PUT /identity/v3/projects/8a614ae0a9a8463aa0fa3ece928d37d4/users/7ceeb4bf8cfa45498119db4ea4266481/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:20:41.169162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.169464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.169774 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.202518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] MFA Rules not processed for user `7ceeb4bf8cfa45498119db4ea4266481`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:41.204175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:41.261517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:41.312549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1279/2565] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:41.317786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.420538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:41.427227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2549-00c5-47a1-88fa-19c87ce49c71 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.455269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.455976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.456264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.456546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.457251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.459248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.495135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1287/2566] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:20:41.497271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.514513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7c0fb-da83-451f-9643-29a9da1d4ca2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.664012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.664818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.665111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.665397 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.666111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.668316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.712084 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1280/2567] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:20:41 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:20:41.712886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.728184 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e09f9-c906-498a-89a6-f01998a3aa4e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.734966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.735837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.736194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.736684 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.737925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.739841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.756083 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1288/2568] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:41.758994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.770661 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55594d12-16b1-4da9-bbac-32b913741cc0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.782919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.785073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.785401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.785693 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] PATH_INFO: `/v3/projects/1b31707b66f74c75859e9de40c46a13c/users/07dbcbdef98444ae8f86ea31bfe19092/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.803476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b31707b66f74c75859e9de40c46a13c, user_id=07dbcbdef98444ae8f86ea31bfe19092, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.806211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.832849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1281/2569] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:41 2022] PUT /identity/v3/projects/1b31707b66f74c75859e9de40c46a13c/users/07dbcbdef98444ae8f86ea31bfe19092/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:41.836566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.853546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd907c-0496-4749-9cde-6280b311e115 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.941312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680619-d9e9-4a8b-bf55-aecd955eb8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.942437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680619-d9e9-4a8b-bf55-aecd955eb8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.942868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680619-d9e9-4a8b-bf55-aecd955eb8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.943454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680619-d9e9-4a8b-bf55-aecd955eb8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.944426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b680619-d9e9-4a8b-bf55-aecd955eb8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.946841 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b680619-d9e9-4a8b-bf55-aecd955eb8d3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:41.960188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1289/2570] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:20:41.964133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:41.976758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f4f3-bacb-4f5a-91dd-f33ffa4a15a0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:41.981855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:41.982968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:41.983425 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:41.984455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] PATH_INFO: `/v3/projects/1b31707b66f74c75859e9de40c46a13c/users/07dbcbdef98444ae8f86ea31bfe19092/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:41.986658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b31707b66f74c75859e9de40c46a13c, user_id=07dbcbdef98444ae8f86ea31bfe19092, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:41.989556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:42.005234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1282/2571] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:20:41 2022] PUT /identity/v3/projects/1b31707b66f74c75859e9de40c46a13c/users/07dbcbdef98444ae8f86ea31bfe19092/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:20:42.017625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:42.017924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:42.018215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:42.064344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] MFA Rules not processed for user `07dbcbdef98444ae8f86ea31bfe19092`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:20:42.065667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:42.144311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1290/2572] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:20:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:20:42.156336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:42.158173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:42.216956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb2d90-db92-4bc9-81ee-b5743859acc3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:42.221178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:42.221857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:42.222145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:42.222427 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:42.268021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:42.280269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:42.282453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:42.291396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1283/2573] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:52.141288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:52.287314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:58.372640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:58.382707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddb9d7-6ab2-498a-a0a4-9b606b3a3ba9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:58.386362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:58.387043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:58.387368 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:58.387652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:58.397724 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:58.399248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:58.409754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1291/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:20:59.688514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:20:59.690303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:59.775531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86229614-7eae-4925-b89d-8c65c210da85 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:20:59.781680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:20:59.782273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:20:59.782562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:20:59.782841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:20:59.784689 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:20:59.797566 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:20:59.799197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03cc7-b9da-4dee-abbe-14fe6627b664 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:20:59.809698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1284/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:20:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:08.404668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:09.805178 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=34 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:27.140812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:27.142352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:27.208865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b88a0-33cd-4b66-bcc4-47fc501da1a8 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:27.213518 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:27.214392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.214678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.214958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] PATH_INFO: `/v3/users/7564265e3f59461fa0937fa0f6581c8a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:27.216182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7564265e3f59461fa0937fa0f6581c8a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:27.218366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:27.264691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7564265e3f59461fa0937fa0f6581c8a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.265347 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7564265e3f59461fa0937fa0f6581c8a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.272527 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7564265e3f59461fa0937fa0f6581c8a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.273191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7564265e3f59461fa0937fa0f6581c8a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.280990 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7564265e3f59461fa0937fa0f6581c8a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.299741 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1292/2576] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:27 2022] DELETE /identity/v3/users/7564265e3f59461fa0937fa0f6581c8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:27.304191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.304708 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.304813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:27.322648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:27.323865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:27.386192 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1285/2577] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:27.396751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:27.398174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:27.457604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086be2b-a31c-403e-97a7-10c78142dea9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:27.461292 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:27.461868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.462150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.462427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:27.471982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:27.473402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:27.483330 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1293/2578] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:27.686647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:27.696436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e434d-ed55-41e8-a7ad-9b18da63e0f7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:27.700563 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:27.701145 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.701433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.701716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:27.703641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:27.717701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:27.719131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5975bd-48a6-4877-8d43-bc8b8fa52c47 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:27.731156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1286/2579] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:27.768136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:27.769728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:27.789250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915ad9-04ac-41dc-a0c9-7cc7f8e64c0f service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:27.796915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:27.797907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.798109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.798391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] PATH_INFO: `/v3/projects/76ec906819044d9aaa3dfd600cc1178b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:27.799697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ec906819044d9aaa3dfd600cc1178b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:27.801612 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:27.819756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:27.853189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ec906819044d9aaa3dfd600cc1178b', 'request_id': 'req-959c233f-b131-45f8-a3c6-b31baf0a19df'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.862085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ec906819044d9aaa3dfd600cc1178b', 'request_id': 'req-959c233f-b131-45f8-a3c6-b31baf0a19df'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.868976 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ec906819044d9aaa3dfd600cc1178b', 'request_id': 'req-959c233f-b131-45f8-a3c6-b31baf0a19df'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.880038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] The token cache is being invalidate because project 76ec906819044d9aaa3dfd600cc1178b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:27.880328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.881018 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-959c233f-b131-45f8-a3c6-b31baf0a19df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:27.882645 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1294/2580] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:27 2022] DELETE /identity/v3/projects/76ec906819044d9aaa3dfd600cc1178b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:27.888121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.888415 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.889230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:27.908198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:27.909406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:27.974302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1287/2581] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:27.981917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:27.982206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:27.983047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.001489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:28.002978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:28.011468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1295/2582] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:28.016138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.025933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fc83b-4b1b-4b5a-ac5a-f9c058b06aaa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.031311 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.031989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.032277 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.032559 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.033298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:28.033609 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.035319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.052930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1288/2583] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:28.054091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.064319 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43243542-c296-49e7-80b8-e020e4bd9f35 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.069463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.070131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.070557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.070847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.071587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.073499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.112752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1296/2584] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:28 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:28.113957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.124793 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc33c-3d99-440a-b143-70f067b2643e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.184921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.186323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.186688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.186978 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.187738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.189886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.215626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1289/2585] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:28 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:21:28.217174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.228416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279722-ac26-45dd-8745-2adee9bdfb99 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.233992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.234716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.235008 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.235326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.236079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.237715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.252916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1297/2586] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:28.254206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.261305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:28.267608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae987b5-1848-4577-8517-c3b7e730ccfd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.273314 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c148f93-4ae6-4440-8faa-cf2ce1ada151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.274094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148f93-4ae6-4440-8faa-cf2ce1ada151 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.274453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148f93-4ae6-4440-8faa-cf2ce1ada151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.274799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148f93-4ae6-4440-8faa-cf2ce1ada151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.275590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c148f93-4ae6-4440-8faa-cf2ce1ada151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.277214 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c148f93-4ae6-4440-8faa-cf2ce1ada151 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.291699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1290/2587] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:28.292996 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.304752 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4be8d8-63fc-4ef0-88d7-c45823f58fdc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.309924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.312067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.312357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.312739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] PATH_INFO: `/v3/projects/993ea5ded54d4522a246ea3eb001af97/users/8b1010b5cc634e0bbedf0494de1477a8/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.329904 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=993ea5ded54d4522a246ea3eb001af97, user_id=8b1010b5cc634e0bbedf0494de1477a8, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.332605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.347370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1298/2588] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:28 2022] PUT /identity/v3/projects/993ea5ded54d4522a246ea3eb001af97/users/8b1010b5cc634e0bbedf0494de1477a8/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:28.359482 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.360077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.360185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.389876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] MFA Rules not processed for user `8b1010b5cc634e0bbedf0494de1477a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:28.391447 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:28.460861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1291/2589] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:28.474602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:28.476324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:28.537393 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314b8ea-709b-4f97-8cf7-0026f512d273 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:28.541020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:28.541963 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:28.542247 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:28.542521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:28.552252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:28.553704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:28.563703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1299/2590] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:30.978646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:30.980225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:31.063384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e82b3-8df4-4213-9ba4-336fa2618807 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.068007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.068879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.069170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.069454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] PATH_INFO: `/v3/users/1748648695bb46a9b2c7912c48e95bbd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.070646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1748648695bb46a9b2c7912c48e95bbd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.072629 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.119875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1748648695bb46a9b2c7912c48e95bbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.128456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1748648695bb46a9b2c7912c48e95bbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.129211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1748648695bb46a9b2c7912c48e95bbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.142237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1748648695bb46a9b2c7912c48e95bbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.142909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca9353d-3b7a-4860-9f7f-5cd8830096eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1748648695bb46a9b2c7912c48e95bbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.156762 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1292/2591] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:30 2022] DELETE /identity/v3/users/1748648695bb46a9b2c7912c48e95bbd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:31.351374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.362874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c020e51-0e6d-4fb9-90ab-8f008b30267d service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.415419 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:31.431836 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.432734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.433017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.433295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] PATH_INFO: `/v3/projects/b9de893c8bbd47b59e136fe46e791a52` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.434472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9de893c8bbd47b59e136fe46e791a52)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.436655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.484134 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9de893c8bbd47b59e136fe46e791a52', 'request_id': 'req-cd672107-2147-449b-a03a-42902449ad62'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.493366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9de893c8bbd47b59e136fe46e791a52', 'request_id': 'req-cd672107-2147-449b-a03a-42902449ad62'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.501405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9de893c8bbd47b59e136fe46e791a52', 'request_id': 'req-cd672107-2147-449b-a03a-42902449ad62'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.512829 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] The token cache is being invalidate because project b9de893c8bbd47b59e136fe46e791a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:31.513125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.514962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cd672107-2147-449b-a03a-42902449ad62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:31.516833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1300/2592] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:31 2022] DELETE /identity/v3/projects/b9de893c8bbd47b59e136fe46e791a52 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:31.522596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.522910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.523206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.530751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:31.545570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:31.546897 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:31.609128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1293/2593] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:31.617655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.617975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.618258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.638128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:31.639948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:31.648296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1301/2594] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:31.652876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.664205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b16b1e-2eed-457c-95bb-13b00b0cf1d7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.669155 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.670062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.670450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.670738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.671569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:31.671888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.673596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.686521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1294/2595] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:31.691286 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.700727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a724d85-411a-4f34-a9ed-9b3c271f1552 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.706014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.706766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.707064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.707505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.708345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.710608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.740335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1302/2596] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:31 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:31.744448 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.754662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147666e-5002-4775-a4ac-5cd0d28fa65e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.815320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.816001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.816292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.816573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.817265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.819279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.846363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1295/2597] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:31 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:31.847812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.859416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d39c4-f22c-42a0-95b4-42b94f43a273 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.864047 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.864698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.864981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.865263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.870578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.872204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.883263 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1303/2598] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:31.887220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.898548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef05ea8-7c8d-4e68-a72f-0cc062e65de5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.903867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117429c-de80-4399-99b6-270cacfd2826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.905098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117429c-de80-4399-99b6-270cacfd2826 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.905098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117429c-de80-4399-99b6-270cacfd2826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.905746 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117429c-de80-4399-99b6-270cacfd2826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.906346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117429c-de80-4399-99b6-270cacfd2826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.907995 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117429c-de80-4399-99b6-270cacfd2826 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.918852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1296/2599] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:31.924190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:31.934401 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45be2-a8f5-42c3-86d7-fd13facf670b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:31.939177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:31.940049 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.940334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.940611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] PATH_INFO: `/v3/projects/947a82306c9e4cd7bf6c19cac3f2dad3/users/6c51b5dc83084fcd8b90598cf82b3ea7/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:31.956439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947a82306c9e4cd7bf6c19cac3f2dad3, user_id=6c51b5dc83084fcd8b90598cf82b3ea7, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:31.959048 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:31.973974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1304/2600] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:31 2022] PUT /identity/v3/projects/947a82306c9e4cd7bf6c19cac3f2dad3/users/6c51b5dc83084fcd8b90598cf82b3ea7/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:31.984939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:31.985433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:31.985544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.017573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] MFA Rules not processed for user `6c51b5dc83084fcd8b90598cf82b3ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:32.018864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:32.084547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:32.091403 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1297/2601] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:32.096345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.168759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40a0b1-dafc-4a67-9088-40b575a658a9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.173919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.174588 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.174878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.175196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.175911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.177925 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.194379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:32.212956 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1305/2602] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:32 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:32.218529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.230255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a205c7-eab4-4ccc-88fb-0eb8f6b67710 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.287959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.288526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.288815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.289097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.289797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.291769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.311110 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1298/2603] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:32 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:32.315178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.325337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1e68a-e623-4242-962b-66d598738525 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.330705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.331400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.331689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.331970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.332690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.334285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.345536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1306/2604] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:32.349595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.360451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0daf-4699-4324-97e4-f7a77cfc84b2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.365220 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.366094 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.366381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.366665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] PATH_INFO: `/v3/projects/7159b859f4c94baf801d98ffb71a0417/users/5624ef97a6f140f093928c39c41d0f9e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.381274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7159b859f4c94baf801d98ffb71a0417, user_id=5624ef97a6f140f093928c39c41d0f9e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.383980 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.399635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1299/2605] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:32 2022] PUT /identity/v3/projects/7159b859f4c94baf801d98ffb71a0417/users/5624ef97a6f140f093928c39c41d0f9e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:32.403594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.414428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52c7f-7ae6-427d-bb9a-a0f1e1b0b8ca admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.471982 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d244c04-9ec2-4be4-8262-69377374414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.472648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d244c04-9ec2-4be4-8262-69377374414d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.472933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d244c04-9ec2-4be4-8262-69377374414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.473214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d244c04-9ec2-4be4-8262-69377374414d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.473936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d244c04-9ec2-4be4-8262-69377374414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.475566 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d244c04-9ec2-4be4-8262-69377374414d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.485335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1307/2606] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:32.489665 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.501451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626384a-fdb6-445b-842d-5548add95bab admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.506477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.507432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.507727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.508012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] PATH_INFO: `/v3/projects/7159b859f4c94baf801d98ffb71a0417/users/5624ef97a6f140f093928c39c41d0f9e/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.509984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7159b859f4c94baf801d98ffb71a0417, user_id=5624ef97a6f140f093928c39c41d0f9e, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.512698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.523812 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1300/2607] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:32 2022] PUT /identity/v3/projects/7159b859f4c94baf801d98ffb71a0417/users/5624ef97a6f140f093928c39c41d0f9e/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:32.535420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.535712 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.535989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.564132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] MFA Rules not processed for user `5624ef97a6f140f093928c39c41d0f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:32.565249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:32.641439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1308/2608] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:32.652655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.655012 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:32.737273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f1e2f-0be6-40fa-b54c-bbb475ddaa90 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.741230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47ded-8b8c-47cc-a160-8db548207a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.741879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47ded-8b8c-47cc-a160-8db548207a51 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.742170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47ded-8b8c-47cc-a160-8db548207a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.742451 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47ded-8b8c-47cc-a160-8db548207a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.751816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47ded-8b8c-47cc-a160-8db548207a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.753272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47ded-8b8c-47cc-a160-8db548207a51 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.763612 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1301/2609] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:32.794298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:32.858087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510887-356a-41a0-8599-e499b1ad8e4f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:32.864874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:32.865776 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.866064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.866346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] PATH_INFO: `/v3/users/6c51b5dc83084fcd8b90598cf82b3ea7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.867654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c51b5dc83084fcd8b90598cf82b3ea7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:32.869619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:32.880410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:32.926135 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c51b5dc83084fcd8b90598cf82b3ea7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:32.926883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c51b5dc83084fcd8b90598cf82b3ea7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:32.940959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c51b5dc83084fcd8b90598cf82b3ea7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:32.941758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c51b5dc83084fcd8b90598cf82b3ea7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:32.951374 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c51b5dc83084fcd8b90598cf82b3ea7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:32.971428 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1309/2610] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:32 2022] DELETE /identity/v3/users/6c51b5dc83084fcd8b90598cf82b3ea7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:32.975776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:32.976167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:32.976678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:32.996595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:32.997996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:33.033248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:33.066643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1302/2611] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:33.076144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:33.077539 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:33.140675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41775-209e-4b05-b071-7dda91a909ee admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:33.144285 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:33.144934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:33.145224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:33.145558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:33.155385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:33.156945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:33.166943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1310/2612] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:33.465715 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:33.468097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:33.480865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef3eb6-35cb-4f3c-ad89-817bc38d8e89 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:33.486785 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:33.487749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:33.488030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:33.488312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] PATH_INFO: `/v3/projects/947a82306c9e4cd7bf6c19cac3f2dad3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:33.489503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] RBAC: Authorizing `identity:delete_project(project_id=947a82306c9e4cd7bf6c19cac3f2dad3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:33.491471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:33.551959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947a82306c9e4cd7bf6c19cac3f2dad3', 'request_id': 'req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.558262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947a82306c9e4cd7bf6c19cac3f2dad3', 'request_id': 'req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.564198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947a82306c9e4cd7bf6c19cac3f2dad3', 'request_id': 'req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.579688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] The token cache is being invalidate because project 947a82306c9e4cd7bf6c19cac3f2dad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:33.579981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.580646 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.582210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1303/2613] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:33 2022] DELETE /identity/v3/projects/947a82306c9e4cd7bf6c19cac3f2dad3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:33.586361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:33.597488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d57ebf-c10a-423f-afca-c64ce5f6eab4 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:33.655258 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:33.656246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:33.656544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:33.656822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] PATH_INFO: `/v3/users/5624ef97a6f140f093928c39c41d0f9e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:33.658016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5624ef97a6f140f093928c39c41d0f9e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:33.660218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:33.693939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:33.710170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5624ef97a6f140f093928c39c41d0f9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.710830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5624ef97a6f140f093928c39c41d0f9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.718333 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5624ef97a6f140f093928c39c41d0f9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.718994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5624ef97a6f140f093928c39c41d0f9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.725558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-37b8db06-7a42-4bb5-92e6-2c54334ed694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5624ef97a6f140f093928c39c41d0f9e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:33.743403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1311/2614] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:33 2022] DELETE /identity/v3/users/5624ef97a6f140f093928c39c41d0f9e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:34.027060 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.032662 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:34.048007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077ae9-c9d6-4128-9aff-8b0de5d0406c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.116491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.117457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.117751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.118073 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] PATH_INFO: `/v3/projects/7159b859f4c94baf801d98ffb71a0417` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.119337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7159b859f4c94baf801d98ffb71a0417)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.121353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.179928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7159b859f4c94baf801d98ffb71a0417', 'request_id': 'req-819606bb-455f-44f1-b903-d3cf5101c080'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:34.191991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7159b859f4c94baf801d98ffb71a0417', 'request_id': 'req-819606bb-455f-44f1-b903-d3cf5101c080'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:34.196818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:34.199228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7159b859f4c94baf801d98ffb71a0417', 'request_id': 'req-819606bb-455f-44f1-b903-d3cf5101c080'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:34.218252 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] The token cache is being invalidate because project 7159b859f4c94baf801d98ffb71a0417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:34.218547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:34.219293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-819606bb-455f-44f1-b903-d3cf5101c080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:34.220998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1304/2615] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:34 2022] DELETE /identity/v3/projects/7159b859f4c94baf801d98ffb71a0417 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:34.225795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.226087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.226369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.244892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:34.246183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:34.347318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1312/2616] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:34.352500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.352804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.353085 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.372102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:34.373554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:34.382278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1305/2617] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:34.386529 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.399270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07624a-0d0e-4266-a6b9-7fdf5a23b77a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.405437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.406171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.406465 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.406970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.408009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:34.408476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.410450 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.424281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1313/2618] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:34.428575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.437927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fea44f-a205-40e4-9a6f-14882cac0b39 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.443351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.444021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.444454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.444628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.445377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.447315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.475556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1306/2619] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:34.479930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.493260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328da3fc-b3ac-43d0-96cc-6f7703461e62 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.557616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.558232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.559237 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.561365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.562140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.564486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.586678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1314/2620] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/users => generated 304 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:34.592158 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.603984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0899-eaae-4402-9a95-99222d237b81 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.609771 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.610444 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.610735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.611014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.611796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.613433 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.624768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1307/2621] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:21:34.629037 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.639291 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc800c-7245-4751-b2d5-fa259434f693 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.644595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed6cf8-d011-483c-a270-af57e48bbd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.645329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed6cf8-d011-483c-a270-af57e48bbd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.645646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed6cf8-d011-483c-a270-af57e48bbd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.645931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed6cf8-d011-483c-a270-af57e48bbd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.646731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed6cf8-d011-483c-a270-af57e48bbd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.648486 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed6cf8-d011-483c-a270-af57e48bbd7d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.660217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1315/2622] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:34.664431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.675107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529b744-3ae5-4514-8bef-655109f6b7db admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.679644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.680509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.680796 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.681091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] PATH_INFO: `/v3/projects/b7898f21d5af431a98f77c40fd47635a/users/43a729952acc4e9795598c39827a087c/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.695779 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7898f21d5af431a98f77c40fd47635a, user_id=43a729952acc4e9795598c39827a087c, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.698437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.712473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1308/2623] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:34 2022] PUT /identity/v3/projects/b7898f21d5af431a98f77c40fd47635a/users/43a729952acc4e9795598c39827a087c/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:34.723690 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.723919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.724199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.752611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:34.755861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] MFA Rules not processed for user `43a729952acc4e9795598c39827a087c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:34.757678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:34.826540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1316/2624] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:34.831227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.894952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628c250-238c-4966-8cca-9be93444e205 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:34.899839 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:34.900533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:34.900819 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:34.901097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:34.901795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:34.903756 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:34.931132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1309/2625] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:34.935546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:34.947359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9c716-a228-4860-8121-703bc8771a79 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.008102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.008838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.009197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.009544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.010344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.012763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.037489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1317/2626] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:34 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:35.039022 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:35.050175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5e775-3e1d-4c45-ac52-8d64d2f2fa2c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.055005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.055700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.055993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.056286 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.057019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.058634 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.069336 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1310/2627] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:35.073622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:35.085042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154b5d3-45eb-4c20-a186-89caeeecd40f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.089917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.090795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.091102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.091460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] PATH_INFO: `/v3/projects/d0be336ebd4747398d34af17a8cb6f69/users/a0827726f5a64176bf91cac6b2853ba5/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.113091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0be336ebd4747398d34af17a8cb6f69, user_id=a0827726f5a64176bf91cac6b2853ba5, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.116039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.129426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1318/2628] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:35 2022] PUT /identity/v3/projects/d0be336ebd4747398d34af17a8cb6f69/users/a0827726f5a64176bf91cac6b2853ba5/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:35.133353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:35.145006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33541f-c189-4eb1-a720-b9b5a61d0df8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.195910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:35.205303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c74fd-2d77-4df6-b628-5a82c08b6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.206499 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c74fd-2d77-4df6-b628-5a82c08b6b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.207312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c74fd-2d77-4df6-b628-5a82c08b6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.207716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c74fd-2d77-4df6-b628-5a82c08b6b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.208504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c74fd-2d77-4df6-b628-5a82c08b6b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.210185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c74fd-2d77-4df6-b628-5a82c08b6b0f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.224112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1311/2629] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:35.226665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:35.237133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b93fa8-2c4b-40b7-a1be-b283f4303777 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.241968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.242883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.243195 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.243475 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] PATH_INFO: `/v3/projects/d0be336ebd4747398d34af17a8cb6f69/users/a0827726f5a64176bf91cac6b2853ba5/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.245421 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0be336ebd4747398d34af17a8cb6f69, user_id=a0827726f5a64176bf91cac6b2853ba5, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.248342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.258695 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1319/2630] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:35 2022] PUT /identity/v3/projects/d0be336ebd4747398d34af17a8cb6f69/users/a0827726f5a64176bf91cac6b2853ba5/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:35.269625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.269947 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.270228 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.297507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] MFA Rules not processed for user `a0827726f5a64176bf91cac6b2853ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:35.299348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:35.368798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1312/2631] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:35.382577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:35.385909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:35.452470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762c3a5-de35-40a1-b333-fa7bb0ea83ef admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.456179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.456830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.457115 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.457395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.466348 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.468097 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.472093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:35.479885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1320/2632] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:35.638471 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:35.640684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:35.653872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c917662-5613-4923-9389-fe3b28e88982 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:35.658249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aa28a-52a2-4e9a-b789-26fa90190d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:35.658906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aa28a-52a2-4e9a-b789-26fa90190d40 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:35.659233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aa28a-52a2-4e9a-b789-26fa90190d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:35.659523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aa28a-52a2-4e9a-b789-26fa90190d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:35.723970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aa28a-52a2-4e9a-b789-26fa90190d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:35.725483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aa28a-52a2-4e9a-b789-26fa90190d40 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:35.734745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1313/2633] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:36.726757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:36.728207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:36.795303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72565c99-d5a4-4eda-8d2e-53dc5242e81f service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:36.799981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:36.800855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:36.801144 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:36.801426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] PATH_INFO: `/v3/users/7ceeb4bf8cfa45498119db4ea4266481` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:36.802607 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ceeb4bf8cfa45498119db4ea4266481)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:36.805009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:36.853915 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ceeb4bf8cfa45498119db4ea4266481'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:36.854573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ceeb4bf8cfa45498119db4ea4266481'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:36.862514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ceeb4bf8cfa45498119db4ea4266481'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:36.863170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ceeb4bf8cfa45498119db4ea4266481'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:36.870365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ceeb4bf8cfa45498119db4ea4266481'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:36.888306 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1321/2634] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:36 2022] DELETE /identity/v3/users/7ceeb4bf8cfa45498119db4ea4266481 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:36.894193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:36.894685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:36.894884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:36.913904 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:36.915116 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:36.977577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1314/2635] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:36.987935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:36.989345 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:37.050578 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6635b2-5859-4509-be5c-a692cea0a5d1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:37.054357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:37.055016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:37.055454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:37.055746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:37.066448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:37.067865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:37.078847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1322/2636] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:37.385987 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:37.389445 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:37.409165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c14ea-f531-456d-9c63-664b0d91d883 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:37.414302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:37.415048 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:37.415369 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:37.415655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] PATH_INFO: `/v3/projects/8a614ae0a9a8463aa0fa3ece928d37d4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:37.416838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a614ae0a9a8463aa0fa3ece928d37d4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:37.418784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:37.431203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:37.474241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a614ae0a9a8463aa0fa3ece928d37d4', 'request_id': 'req-45df884f-e133-4cad-b811-0fe45ad09ce6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.480851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a614ae0a9a8463aa0fa3ece928d37d4', 'request_id': 'req-45df884f-e133-4cad-b811-0fe45ad09ce6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.486972 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a614ae0a9a8463aa0fa3ece928d37d4', 'request_id': 'req-45df884f-e133-4cad-b811-0fe45ad09ce6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.500413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] The token cache is being invalidate because project 8a614ae0a9a8463aa0fa3ece928d37d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:37.500716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.501409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.506370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1315/2637] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:37 2022] DELETE /identity/v3/projects/8a614ae0a9a8463aa0fa3ece928d37d4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:37.507332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:37.518542 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737cd6-1e22-4043-b4e4-53f32d27210d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:37.535832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:37.581042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:37.581919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:37.582204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:37.582483 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] PATH_INFO: `/v3/users/07dbcbdef98444ae8f86ea31bfe19092` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:37.583702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07dbcbdef98444ae8f86ea31bfe19092)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:37.585602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:37.630534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07dbcbdef98444ae8f86ea31bfe19092'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.631215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07dbcbdef98444ae8f86ea31bfe19092'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.638081 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07dbcbdef98444ae8f86ea31bfe19092'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.639335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07dbcbdef98444ae8f86ea31bfe19092'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.646905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-40cbc7a7-7470-4128-b268-cdc2d66d781e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07dbcbdef98444ae8f86ea31bfe19092'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:37.664808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1323/2638] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:37 2022] DELETE /identity/v3/users/07dbcbdef98444ae8f86ea31bfe19092 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:37.948870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:37.950545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:37.967576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df884f-e133-4cad-b811-0fe45ad09ce6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.029527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.030521 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.030811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.031115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] PATH_INFO: `/v3/projects/1b31707b66f74c75859e9de40c46a13c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.032353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b31707b66f74c75859e9de40c46a13c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.034472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.087828 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b31707b66f74c75859e9de40c46a13c', 'request_id': 'req-93a8de8c-149f-4af1-aab4-d970db739472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:38.095529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b31707b66f74c75859e9de40c46a13c', 'request_id': 'req-93a8de8c-149f-4af1-aab4-d970db739472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:38.101382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b31707b66f74c75859e9de40c46a13c', 'request_id': 'req-93a8de8c-149f-4af1-aab4-d970db739472'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:38.114097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] The token cache is being invalidate because project 1b31707b66f74c75859e9de40c46a13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:38.114387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:38.115004 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-93a8de8c-149f-4af1-aab4-d970db739472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:38.116596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1316/2639] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:37 2022] DELETE /identity/v3/projects/1b31707b66f74c75859e9de40c46a13c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:38.121966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.122616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.122616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.142521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:38.143734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:38.206958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1324/2640] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:38.214903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.215246 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.215534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.235874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:38.237097 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:38.245245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1317/2641] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:38.249822 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.260079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0c5fc-7d73-4db2-9ab4-922b74e2615f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.265220 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.266131 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.266418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.266814 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.267593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:38.267907 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.269505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.281869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1325/2642] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:38.286123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.295929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1389fc-5a78-4295-803e-8932daaea4ec None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.300685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.301363 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.301647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.301927 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.302625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.304569 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.334803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1318/2643] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:38.337029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.349056 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6acf2-07e7-4501-ac2f-8d08a3c30378 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.375534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:38.414533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.415283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.415659 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.415940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.416660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.418755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.440630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1326/2644] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:38.444584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.450045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:38.456998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a81f9-aa01-4e8c-a8e9-f85a398ac68b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.462536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.463243 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.463535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.463813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.464542 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.466139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.477271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1319/2645] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:38.481449 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.491815 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f01287-7b42-45ba-84cf-bfac658c87bf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.496736 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561952b-aa3a-420c-8747-927921ef7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.497403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561952b-aa3a-420c-8747-927921ef7ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.498206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561952b-aa3a-420c-8747-927921ef7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.498732 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561952b-aa3a-420c-8747-927921ef7ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.499277 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561952b-aa3a-420c-8747-927921ef7ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.500908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561952b-aa3a-420c-8747-927921ef7ab0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.516230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1327/2646] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:38.517301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.527564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d48ea-ae35-4df5-ae86-24c738ec035a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.533781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.534666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.534892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.535241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] PATH_INFO: `/v3/projects/d6365198ca1e4ee8a411657f083e4172/users/2779b0005ad64153968e081b0f82ca98/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.551015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6365198ca1e4ee8a411657f083e4172, user_id=2779b0005ad64153968e081b0f82ca98, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.553836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.569241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1320/2647] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:38 2022] PUT /identity/v3/projects/d6365198ca1e4ee8a411657f083e4172/users/2779b0005ad64153968e081b0f82ca98/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:38.581441 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.581760 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.582044 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.611426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] MFA Rules not processed for user `2779b0005ad64153968e081b0f82ca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:38.612693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:38.679181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1328/2648] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:38.683724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.750821 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06f19-c99b-4457-af80-fa0ceb884c97 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.756309 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.756983 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.757276 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.757561 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.758258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.760283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.788206 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1321/2649] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:38.792255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.803630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45327fc7-9a05-465b-a340-f55dc6a5d121 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.861565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.862239 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.862532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.862928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.863573 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.865548 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.889865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1329/2650] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:38 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:38.891517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.901801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c7b6-4a87-477f-889d-11f19b834bba admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.907416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.908201 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.908517 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.908838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.909644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.911598 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.928058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1322/2651] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:38.929295 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.939960 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07a6e8-aba5-4129-b209-ea01d60fba6e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:38.944818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:38.945699 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:38.945985 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:38.946267 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] PATH_INFO: `/v3/projects/63176b92bc9b49d5b8d4589a95831d67/users/5c2598d12a2e4d0c89729f9cb803c026/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:38.962420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63176b92bc9b49d5b8d4589a95831d67, user_id=5c2598d12a2e4d0c89729f9cb803c026, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:38.965125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:38.974519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:38.979974 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1330/2652] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:38 2022] PUT /identity/v3/projects/63176b92bc9b49d5b8d4589a95831d67/users/5c2598d12a2e4d0c89729f9cb803c026/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:38.984247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:38.994375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70fd5-bb1e-4e9a-b12a-713a64941614 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:39.053372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906c0f-ba97-46b1-8a11-f25fdfa38cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:39.054045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906c0f-ba97-46b1-8a11-f25fdfa38cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.054333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906c0f-ba97-46b1-8a11-f25fdfa38cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.054617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906c0f-ba97-46b1-8a11-f25fdfa38cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.055407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906c0f-ba97-46b1-8a11-f25fdfa38cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:39.057018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906c0f-ba97-46b1-8a11-f25fdfa38cd9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:39.066813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1323/2653] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:21:39.071017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:39.081790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48312ef-4b77-4c6e-bd72-667d26e9fec2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:39.086740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:39.087650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.087935 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.088205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] PATH_INFO: `/v3/projects/63176b92bc9b49d5b8d4589a95831d67/users/5c2598d12a2e4d0c89729f9cb803c026/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.090172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63176b92bc9b49d5b8d4589a95831d67, user_id=5c2598d12a2e4d0c89729f9cb803c026, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:39.093643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:39.104185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1331/2654] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:39 2022] PUT /identity/v3/projects/63176b92bc9b49d5b8d4589a95831d67/users/5c2598d12a2e4d0c89729f9cb803c026/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:39.115343 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.115703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.116001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.142526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] MFA Rules not processed for user `5c2598d12a2e4d0c89729f9cb803c026`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:39.143752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:39.169304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:39.213389 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1324/2655] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:39.224945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:39.226713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:39.284064 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f56a9e-6ed3-4e2e-98a3-3f3a5f34a15f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:39.287665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeebee4-ee22-4946-a3e5-0b8083e0b524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:39.288305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeebee4-ee22-4946-a3e5-0b8083e0b524 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.288591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeebee4-ee22-4946-a3e5-0b8083e0b524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.288873 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeebee4-ee22-4946-a3e5-0b8083e0b524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.297957 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeebee4-ee22-4946-a3e5-0b8083e0b524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:39.299353 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeebee4-ee22-4946-a3e5-0b8083e0b524 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:39.308652 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1332/2656] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:39.374108 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:39.441340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18f89c-5f9a-48c8-9e85-1e73a97dc2a8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:39.445889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:39.446753 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.447038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.447347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] PATH_INFO: `/v3/users/2779b0005ad64153968e081b0f82ca98` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.448562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2779b0005ad64153968e081b0f82ca98)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:39.450491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:39.498672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2779b0005ad64153968e081b0f82ca98'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:39.506639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2779b0005ad64153968e081b0f82ca98'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:39.507750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2779b0005ad64153968e081b0f82ca98'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:39.521537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2779b0005ad64153968e081b0f82ca98'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:39.522205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2779b0005ad64153968e081b0f82ca98'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:39.535013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1325/2657] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:39 2022] DELETE /identity/v3/users/2779b0005ad64153968e081b0f82ca98 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:39.539478 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.539778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.540062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.558831 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:39.560007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:39.625770 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1333/2658] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:39.635406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:39.636840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:39.683826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:39.697953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79dacd-c1e5-417d-97b7-854048609c26 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:39.701823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:39.702475 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:39.702764 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:39.703042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:39.712101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:39.713543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:39.723171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1326/2659] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:40.002677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:40.004214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:40.020572 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7764-a884-4142-9d43-5d3c5e8babb1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:40.031043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:40.031043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.031043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.031043 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] PATH_INFO: `/v3/projects/d6365198ca1e4ee8a411657f083e4172` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.031950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6365198ca1e4ee8a411657f083e4172)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:40.032369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:40.079697 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6365198ca1e4ee8a411657f083e4172', 'request_id': 'req-35f56a22-4551-49be-81bc-76a5c7c5f11b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.086940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6365198ca1e4ee8a411657f083e4172', 'request_id': 'req-35f56a22-4551-49be-81bc-76a5c7c5f11b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.094231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6365198ca1e4ee8a411657f083e4172', 'request_id': 'req-35f56a22-4551-49be-81bc-76a5c7c5f11b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.104534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] The token cache is being invalidate because project d6365198ca1e4ee8a411657f083e4172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:40.104828 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.105467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.107151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1334/2660] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:40 2022] DELETE /identity/v3/projects/d6365198ca1e4ee8a411657f083e4172 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:40.112213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:40.121994 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf548-2359-4b16-b600-4cd4e1d5187c service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:40.178318 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:40.179227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.179519 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.179804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] PATH_INFO: `/v3/users/5c2598d12a2e4d0c89729f9cb803c026` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.181003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2598d12a2e4d0c89729f9cb803c026)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:40.182931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:40.229303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2598d12a2e4d0c89729f9cb803c026'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.236352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2598d12a2e4d0c89729f9cb803c026'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.237352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2598d12a2e4d0c89729f9cb803c026'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.250054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2598d12a2e4d0c89729f9cb803c026'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.250711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-501c1d85-280b-4dbb-b1d3-2c78c9743f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2598d12a2e4d0c89729f9cb803c026'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.262726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1327/2661] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:40 2022] DELETE /identity/v3/users/5c2598d12a2e4d0c89729f9cb803c026 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:40.545953 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:40.547677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:40.562210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f56a22-4551-49be-81bc-76a5c7c5f11b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:40.572448 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:40.627011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:40.627933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.628207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.628489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] PATH_INFO: `/v3/projects/63176b92bc9b49d5b8d4589a95831d67` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.629682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63176b92bc9b49d5b8d4589a95831d67)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:40.631618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:40.681007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63176b92bc9b49d5b8d4589a95831d67', 'request_id': 'req-c4d5060d-f2c5-435b-aaa9-464537424552'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.688332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63176b92bc9b49d5b8d4589a95831d67', 'request_id': 'req-c4d5060d-f2c5-435b-aaa9-464537424552'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.694917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63176b92bc9b49d5b8d4589a95831d67', 'request_id': 'req-c4d5060d-f2c5-435b-aaa9-464537424552'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.705885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] The token cache is being invalidate because project 63176b92bc9b49d5b8d4589a95831d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:40.706317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.707058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4d5060d-f2c5-435b-aaa9-464537424552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:40.709072 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1335/2662] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:40 2022] DELETE /identity/v3/projects/63176b92bc9b49d5b8d4589a95831d67 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:40.715308 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.715610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.715901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.735443 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:40.736653 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:40.799704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1328/2663] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:40.807636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.807930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.808212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.828484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:40.829687 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:40.837595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1336/2664] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:40.843137 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:40.849432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:40.853323 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06a022-2254-49a0-a1aa-3714efe875e9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:40.860026 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:40.860916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.861361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.861817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.862560 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:40.862876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:40.864545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:40.876262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1329/2665] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:40.880613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:40.890591 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac232836-fdeb-46ff-874c-9392368765d9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:40.895278 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:40.895994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:40.896283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:40.896565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:40.897266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:40.899240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:40.928093 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1337/2666] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:40 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:40.932240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:40.943188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6508f8-a308-4b8c-9927-c59e217d910b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.002700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.003408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.003698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.003981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.004699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.006710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.027480 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1330/2667] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:40 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:41.032917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:41.044193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489eb94-6eff-4118-8582-818cb12d6d66 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.050238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.050924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.051253 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.051540 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.052276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.053891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.067160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1338/2668] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:21:41.071356 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:41.082522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d0d85-1095-4317-8a22-6afd00dc526d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.087359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b06b-cd8c-43c8-92c0-f0dda96f5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.088020 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b06b-cd8c-43c8-92c0-f0dda96f5d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.088305 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b06b-cd8c-43c8-92c0-f0dda96f5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.088610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b06b-cd8c-43c8-92c0-f0dda96f5d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.089358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517b06b-cd8c-43c8-92c0-f0dda96f5d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.090992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517b06b-cd8c-43c8-92c0-f0dda96f5d56 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.105523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1331/2669] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:41.106928 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:41.117073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8912-e4bd-4434-bd74-ec881dc16f8a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.121601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.122472 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.122783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.123066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] PATH_INFO: `/v3/projects/39ff1af2122c4ca5bb6730cdfa7749d0/users/7de6302fc2864086ba558795aa22757e/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.140556 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ff1af2122c4ca5bb6730cdfa7749d0, user_id=7de6302fc2864086ba558795aa22757e, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.143154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.156835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1339/2670] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:41 2022] PUT /identity/v3/projects/39ff1af2122c4ca5bb6730cdfa7749d0/users/7de6302fc2864086ba558795aa22757e/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:41.168392 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.168862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.168977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.195531 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] MFA Rules not processed for user `7de6302fc2864086ba558795aa22757e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:41.196734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:41.264412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1332/2671] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:41.276206 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:41.277947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:41.326122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:41.347487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272ded-dfcc-4cde-97fc-f7d202f459ed admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.351283 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e28c63-35c5-45ea-bf30-ddead248b744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.351932 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28c63-35c5-45ea-bf30-ddead248b744 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.352219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28c63-35c5-45ea-bf30-ddead248b744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.352498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28c63-35c5-45ea-bf30-ddead248b744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.362174 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e28c63-35c5-45ea-bf30-ddead248b744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.363665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e28c63-35c5-45ea-bf30-ddead248b744 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.373241 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1340/2672] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:41.392565 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:41.456847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb925f-b99c-4f5f-ac79-cb2346666486 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.461505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.462384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.462678 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.462960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] PATH_INFO: `/v3/users/7de6302fc2864086ba558795aa22757e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.464210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de6302fc2864086ba558795aa22757e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.466163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.468346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:41.514970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de6302fc2864086ba558795aa22757e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:41.522457 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de6302fc2864086ba558795aa22757e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:41.523134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de6302fc2864086ba558795aa22757e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:41.535626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de6302fc2864086ba558795aa22757e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:41.536302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de6302fc2864086ba558795aa22757e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:41.548969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1333/2673] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:41 2022] DELETE /identity/v3/users/7de6302fc2864086ba558795aa22757e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:41.553497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.554080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.554080 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.571824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:41.573028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:41.633248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1341/2674] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:41.644549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:41.645931 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:41.706887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d38927-7f11-4038-9353-75c2096d4d65 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:41.710842 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2492a7-f22e-4c2c-99a5-96cf92e05a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:41.711558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2492a7-f22e-4c2c-99a5-96cf92e05a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:41.711848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2492a7-f22e-4c2c-99a5-96cf92e05a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:41.712128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2492a7-f22e-4c2c-99a5-96cf92e05a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:41.721372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2492a7-f22e-4c2c-99a5-96cf92e05a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:41.722810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2492a7-f22e-4c2c-99a5-96cf92e05a7b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:41.732465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1334/2675] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:42.012668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.015155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:42.028549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6bf5-f9e7-409f-86eb-d9e8e454c5aa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.033821 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.034731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.035020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.035337 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] PATH_INFO: `/v3/projects/39ff1af2122c4ca5bb6730cdfa7749d0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.036868 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ff1af2122c4ca5bb6730cdfa7749d0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.038806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.091058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ff1af2122c4ca5bb6730cdfa7749d0', 'request_id': 'req-3b4e779a-2e40-4db5-a909-5e24eb213c07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:42.099608 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ff1af2122c4ca5bb6730cdfa7749d0', 'request_id': 'req-3b4e779a-2e40-4db5-a909-5e24eb213c07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:42.106113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ff1af2122c4ca5bb6730cdfa7749d0', 'request_id': 'req-3b4e779a-2e40-4db5-a909-5e24eb213c07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:42.117626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] The token cache is being invalidate because project 39ff1af2122c4ca5bb6730cdfa7749d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:42.117947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:42.118598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3b4e779a-2e40-4db5-a909-5e24eb213c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:42.125182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1342/2676] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:42 2022] DELETE /identity/v3/projects/39ff1af2122c4ca5bb6730cdfa7749d0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:42.127059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.127391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.127703 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.145503 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:42.146767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:42.210177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1335/2677] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:42.218335 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.218637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.218924 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.237798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:42.239002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:42.247180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1343/2678] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:42.251567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.261592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd6cf-713b-41a1-a48e-005df8ef2891 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.266893 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.267700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.268210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.268574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.269358 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:42.269673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.271354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.284328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1336/2679] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:42.288788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.299164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2f46e-b34b-455f-b043-85212a2828df None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.303805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.304460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.304774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.305053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.305772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.307895 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.335499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1344/2680] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:42.339826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.350745 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26a58-9a42-4c67-89d1-1e2622e6d0b6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.355436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:42.412015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.412700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.412990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.413278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.413977 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.415960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.437766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1337/2681] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:42.441901 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.452812 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bea3d5-1b67-44a8-ab1a-d3d8e0bbcbf9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.457651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.458343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.458653 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.458931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.459740 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.461560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.474451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1345/2682] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:42.478673 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.489631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55eb92-10ce-4733-b5bc-5db8c157ead4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.494298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d4622-aac0-445d-a6fe-cef3723c9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.494956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4622-aac0-445d-a6fe-cef3723c9886 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.495289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4622-aac0-445d-a6fe-cef3723c9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.495577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4622-aac0-445d-a6fe-cef3723c9886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.496339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d4622-aac0-445d-a6fe-cef3723c9886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.498141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d4622-aac0-445d-a6fe-cef3723c9886 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.508466 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1338/2683] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:42.512585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.523536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c986c4-1a85-4300-8f52-4c33b3cee513 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.529722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.530679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.530967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.531279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] PATH_INFO: `/v3/projects/e090c3043c3043f58011ef47468fc9a1/users/61b9e26c9b594a1f9433862e3b12494d/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.547050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e090c3043c3043f58011ef47468fc9a1, user_id=61b9e26c9b594a1f9433862e3b12494d, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.549779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.562503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1346/2684] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:42 2022] PUT /identity/v3/projects/e090c3043c3043f58011ef47468fc9a1/users/61b9e26c9b594a1f9433862e3b12494d/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:42.573683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.573981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.574321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.602658 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] MFA Rules not processed for user `61b9e26c9b594a1f9433862e3b12494d`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:42.603923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:42.672387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1339/2685] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:42.677287 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.683002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:42.747150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6fa31-0751-48d0-a307-9b754117bb9b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.752755 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.753416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.753673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.753954 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.754667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.759128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.783218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1347/2686] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:42.787234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.798656 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b521c9d-67d7-4a3e-9408-6d9889ddbead None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.855249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.855901 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.856183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.856456 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.858095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.860061 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.880249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1340/2687] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:42 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:42.884328 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.895140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f206f-b7f4-4fa5-b4c2-90d2d023898e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.899710 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.900362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.900647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.900927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.901651 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.903290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.913930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1348/2688] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:42.917809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.929074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f59e8-9674-4d73-a375-ca5d059ec937 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.934143 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafa3e8-e5b3-418b-b104-f8e163f5d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.934799 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafa3e8-e5b3-418b-b104-f8e163f5d48b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.935830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafa3e8-e5b3-418b-b104-f8e163f5d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.936541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafa3e8-e5b3-418b-b104-f8e163f5d48b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.937274 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafa3e8-e5b3-418b-b104-f8e163f5d48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.938873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafa3e8-e5b3-418b-b104-f8e163f5d48b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:42.940196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:42.950222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1341/2689] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:42.954251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:42.964444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd591f-505c-49fa-9da5-481f80e0532f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:42.969805 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:42.970623 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:42.970910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:42.971223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] PATH_INFO: `/v3/projects/6b6234c3e0074aaabb30643446efc301/users/25cf37e8f5084262914f2ede29603d7e/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:42.986185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6234c3e0074aaabb30643446efc301, user_id=25cf37e8f5084262914f2ede29603d7e, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:42.988882 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.005079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1349/2690] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:42 2022] PUT /identity/v3/projects/6b6234c3e0074aaabb30643446efc301/users/25cf37e8f5084262914f2ede29603d7e/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:43.018668 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.018969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.019294 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.046500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] MFA Rules not processed for user `25cf37e8f5084262914f2ede29603d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:43.047761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:43.112190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1342/2691] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:43.116845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.181634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e61ae-0bb2-4ba3-a885-d2088c13fe16 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.189312 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.189989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.190280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.190564 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.191357 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.193317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.223615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1350/2692] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:43 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:43.225699 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.237196 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d702e-f9ac-44c1-a16c-1a8ce674457d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.296068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.296751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.297042 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.297326 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.298014 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.299990 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.321860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1343/2693] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:43 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:43.325900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.336355 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19841d-461e-484a-9c18-8ba179a6244e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.341007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.341665 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.341950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.342230 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.342952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.344580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.355981 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1351/2694] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:43.360704 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.370766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2035-06ae-474a-b744-3a469a4a6037 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.376203 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.377101 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.377388 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.377669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] PATH_INFO: `/v3/projects/6e2a8d2ca981435baa56d987bc260bfe/users/995af9a06d774247a351e82cea3f71be/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.393898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2a8d2ca981435baa56d987bc260bfe, user_id=995af9a06d774247a351e82cea3f71be, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.396643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.411960 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1344/2695] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:43 2022] PUT /identity/v3/projects/6e2a8d2ca981435baa56d987bc260bfe/users/995af9a06d774247a351e82cea3f71be/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:43.416035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.426729 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9542f3-8927-4ce0-a341-535c07df3f09 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.451365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:43.486439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36ecdc-e5f0-45d8-a61a-bd305bfeb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.487153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ecdc-e5f0-45d8-a61a-bd305bfeb2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.487442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ecdc-e5f0-45d8-a61a-bd305bfeb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.487721 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36ecdc-e5f0-45d8-a61a-bd305bfeb2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.488452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36ecdc-e5f0-45d8-a61a-bd305bfeb2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.490041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36ecdc-e5f0-45d8-a61a-bd305bfeb2c5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.499911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1352/2696] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:43.504054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.514909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6f65-9bd2-4dac-b80d-d0c3a0c4b055 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.519847 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.520722 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.521011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.521293 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] PATH_INFO: `/v3/projects/6e2a8d2ca981435baa56d987bc260bfe/users/995af9a06d774247a351e82cea3f71be/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.523304 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2a8d2ca981435baa56d987bc260bfe, user_id=995af9a06d774247a351e82cea3f71be, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.525956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.536875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1345/2697] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:43 2022] PUT /identity/v3/projects/6e2a8d2ca981435baa56d987bc260bfe/users/995af9a06d774247a351e82cea3f71be/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:43.546936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.547264 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.547544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.573485 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] MFA Rules not processed for user `995af9a06d774247a351e82cea3f71be`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:43.574672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:43.643315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1353/2698] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:43.655257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:43.656976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:43.700523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:43.718212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb05f-2d60-492c-913a-eb0209445e8c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:43.722128 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:43.722777 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:43.723173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:43.723464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:43.781952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:43.783455 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:43.792669 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1346/2699] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:46.366290 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:46.376673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dedfe7-17bc-4c71-a99b-c8922e716ede None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:46.387711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:46.388878 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:46.389166 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:46.389444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:46.472276 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:46.473641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:46.483826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1354/2700] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:47.109734 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:47.111223 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:47.124115 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e0079-780b-4979-8157-61d6f7e0f4d8 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:47.128468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f59f9-8eb9-4d54-8236-5a6737c74c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:47.129487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f59f9-8eb9-4d54-8236-5a6737c74c6b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:47.129843 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f59f9-8eb9-4d54-8236-5a6737c74c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:47.130260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f59f9-8eb9-4d54-8236-5a6737c74c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:47.143750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f59f9-8eb9-4d54-8236-5a6737c74c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:47.145258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f59f9-8eb9-4d54-8236-5a6737c74c6b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:47.156086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1347/2701] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:47.274498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:47.276029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:47.332112 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:47.349950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86faf68-ae39-4bed-9151-3fdb4f1e24fd service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:47.354489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:47.355395 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:47.355677 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:47.355947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] PATH_INFO: `/v3/users/43a729952acc4e9795598c39827a087c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:47.357714 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a729952acc4e9795598c39827a087c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:47.359674 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:47.406742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a729952acc4e9795598c39827a087c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:47.407531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a729952acc4e9795598c39827a087c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:47.414498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a729952acc4e9795598c39827a087c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:47.415208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a729952acc4e9795598c39827a087c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:47.424190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a729952acc4e9795598c39827a087c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:47.443861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1355/2702] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:47 2022] DELETE /identity/v3/users/43a729952acc4e9795598c39827a087c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:47.449245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:47.449556 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:47.449823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:47.470342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:47.471720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:47.539139 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1348/2703] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:47.549618 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:47.551238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:47.615116 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920db3-c740-4e2f-8262-9f8723ff8cde admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:47.618648 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:47.619318 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:47.619602 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:47.619877 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:47.629876 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:47.631334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:47.641553 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1356/2704] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:47.924906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:47.926370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:47.941446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b50c92-9bf8-466c-851a-46afafa52f2c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:47.947031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:47.948261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:47.948685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:47.949133 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] PATH_INFO: `/v3/projects/b7898f21d5af431a98f77c40fd47635a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:47.950692 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7898f21d5af431a98f77c40fd47635a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:47.952923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:48.003015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7898f21d5af431a98f77c40fd47635a', 'request_id': 'req-64274958-6e51-428c-a74d-4682dbb3e7b1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.009327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7898f21d5af431a98f77c40fd47635a', 'request_id': 'req-64274958-6e51-428c-a74d-4682dbb3e7b1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.018162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7898f21d5af431a98f77c40fd47635a', 'request_id': 'req-64274958-6e51-428c-a74d-4682dbb3e7b1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.037633 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] The token cache is being invalidate because project b7898f21d5af431a98f77c40fd47635a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:48.037939 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.038639 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.040240 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1349/2705] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:47 2022] DELETE /identity/v3/projects/b7898f21d5af431a98f77c40fd47635a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:48.044121 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:48.054727 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368526-7b49-40f7-ad63-90901d9af1aa service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:48.112178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:48.113101 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.113422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.113703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] PATH_INFO: `/v3/users/a0827726f5a64176bf91cac6b2853ba5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.114908 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0827726f5a64176bf91cac6b2853ba5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:48.116871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:48.127808 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:48.165095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0827726f5a64176bf91cac6b2853ba5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.165751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0827726f5a64176bf91cac6b2853ba5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.174806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0827726f5a64176bf91cac6b2853ba5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.175470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0827726f5a64176bf91cac6b2853ba5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.183033 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-654d0455-a4c4-4877-b4fd-1db9dce35473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0827726f5a64176bf91cac6b2853ba5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.201718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1357/2706] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:48 2022] DELETE /identity/v3/users/a0827726f5a64176bf91cac6b2853ba5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:48.479543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:48.481112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:48.489923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:48.498827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64274958-6e51-428c-a74d-4682dbb3e7b1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:48.576237 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:48.577278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.577630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.578002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] PATH_INFO: `/v3/projects/d0be336ebd4747398d34af17a8cb6f69` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.579409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0be336ebd4747398d34af17a8cb6f69)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:48.581949 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:48.645044 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0be336ebd4747398d34af17a8cb6f69', 'request_id': 'req-8515441a-7646-4ba1-bce5-4db404f544aa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.654719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0be336ebd4747398d34af17a8cb6f69', 'request_id': 'req-8515441a-7646-4ba1-bce5-4db404f544aa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.661434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0be336ebd4747398d34af17a8cb6f69', 'request_id': 'req-8515441a-7646-4ba1-bce5-4db404f544aa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.675516 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] The token cache is being invalidate because project d0be336ebd4747398d34af17a8cb6f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:48.675817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.676493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8515441a-7646-4ba1-bce5-4db404f544aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:48.678260 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1350/2707] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:48 2022] DELETE /identity/v3/projects/d0be336ebd4747398d34af17a8cb6f69 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:48.683351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.683847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.683967 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.703201 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:48.704412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:48.768336 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1358/2708] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:48.776134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.776719 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.777074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.799302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:48.800536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:48.808675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1351/2709] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:48.813271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:48.823061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308225a-f39c-4b20-bccc-e47eb61492f7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:48.828849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:48.830014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.830531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.830817 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.831634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:48.831946 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:48.833633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:48.850030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1359/2710] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:48.851731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:48.862189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c051-7c81-42a4-ac53-94b38819243f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:48.868908 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:48.869910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.870394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.870697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.871695 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:48.873748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:48.903242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1352/2711] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:48 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:48.908152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:48.921839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d046-590a-443f-b74c-7b0f2ae7690a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:48.984227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:48.984919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:48.985204 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:48.985484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:48.986210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:48.988227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.007848 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1360/2712] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:48 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:49.011911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.022493 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9ff7e-2f97-461d-971a-8853694144ad admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.027248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.027919 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.028209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.028525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.029795 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.031632 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.047750 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1353/2713] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:49.049025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.055601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:49.060705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24084-ea46-4966-bd90-cedc7cf84fed admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.067408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a541dd-ec1a-4a7d-89be-60582ff694dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.068598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a541dd-ec1a-4a7d-89be-60582ff694dc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.069216 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a541dd-ec1a-4a7d-89be-60582ff694dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.069668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a541dd-ec1a-4a7d-89be-60582ff694dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.070367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a541dd-ec1a-4a7d-89be-60582ff694dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.072344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a541dd-ec1a-4a7d-89be-60582ff694dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.085833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1361/2714] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:21:49.090006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.101104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a82d7-c9e4-4052-95f0-f693c79bbd5a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.105794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.107450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.107838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.108119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] PATH_INFO: `/v3/projects/6f4408f79f0a4c798ea892c7d77cc4d7/users/055590d45612491cb57e12b3b4947435/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.122643 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4408f79f0a4c798ea892c7d77cc4d7, user_id=055590d45612491cb57e12b3b4947435, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.125335 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.139033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1354/2715] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:49 2022] PUT /identity/v3/projects/6f4408f79f0a4c798ea892c7d77cc4d7/users/055590d45612491cb57e12b3b4947435/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:49.149772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.150070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.150354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.179589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] MFA Rules not processed for user `055590d45612491cb57e12b3b4947435`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:49.180806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:49.246543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1362/2716] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:49.251727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.283906 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:49.317916 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78cd9-da5b-4921-8ee1-51c364123cf0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.322697 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.323426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.323717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.324001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.324700 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.327391 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.353364 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1355/2717] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:49 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:49.358087 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.368680 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce0e20-8841-41ac-a226-851587f3f14e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.429471 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.430065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.430349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.430628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.431531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.433444 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.454284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1363/2718] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:49 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:49.458258 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.469350 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aadef-46c1-41fd-b15a-57ea4ce89ad6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.474359 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.475059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.475424 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.475717 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.476511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.478162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.489729 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1356/2719] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:49.493775 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.504646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df02f-77f8-43a7-8959-e48135f65673 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.509326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.510203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.510489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.510765 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] PATH_INFO: `/v3/projects/5d25f90e4b1d4df98b4b61ea7eca2839/users/47be0d041ef7419eb5d899416230bd75/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.526194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d25f90e4b1d4df98b4b61ea7eca2839, user_id=47be0d041ef7419eb5d899416230bd75, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.529231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.541693 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1364/2720] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:49 2022] PUT /identity/v3/projects/5d25f90e4b1d4df98b4b61ea7eca2839/users/47be0d041ef7419eb5d899416230bd75/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:49.546449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.556461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd346b-db6e-4178-9ed6-cb508deef343 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.613879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88740-62d4-4773-88ca-69b91efa2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.614613 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88740-62d4-4773-88ca-69b91efa2459 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.614907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88740-62d4-4773-88ca-69b91efa2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.615230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88740-62d4-4773-88ca-69b91efa2459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.616077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f88740-62d4-4773-88ca-69b91efa2459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.617706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f88740-62d4-4773-88ca-69b91efa2459 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.629247 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1357/2721] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:49.632796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.644590 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4ea38-aa9b-48ca-ab5b-be65f574cc30 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.649227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.650110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.650396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.650673 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] PATH_INFO: `/v3/projects/5d25f90e4b1d4df98b4b61ea7eca2839/users/47be0d041ef7419eb5d899416230bd75/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.652662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d25f90e4b1d4df98b4b61ea7eca2839, user_id=47be0d041ef7419eb5d899416230bd75, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.656615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.667150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1365/2722] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:49 2022] PUT /identity/v3/projects/5d25f90e4b1d4df98b4b61ea7eca2839/users/47be0d041ef7419eb5d899416230bd75/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:49.678891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.679287 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.679752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.708684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] MFA Rules not processed for user `47be0d041ef7419eb5d899416230bd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:49.709914 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:49.794514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1358/2723] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:49.813179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:49.815155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:49.859020 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:49.881030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20a42f-238f-4f0f-9d30-0a0dd7368e2e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:49.884880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:49.885523 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:49.885807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:49.886084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:49.896669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:49.898091 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:49.908362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1366/2724] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:49.995342 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:50.006527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d52de1-fa2d-4220-a28d-6c8d1fa4f162 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:50.010428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4f41-4d94-47bc-a7d8-e32f5ebe2244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:50.011121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4f41-4d94-47bc-a7d8-e32f5ebe2244 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:50.011411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4f41-4d94-47bc-a7d8-e32f5ebe2244 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:50.011720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4f41-4d94-47bc-a7d8-e32f5ebe2244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:50.041611 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:50.084381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4f41-4d94-47bc-a7d8-e32f5ebe2244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:50.085832 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4f41-4d94-47bc-a7d8-e32f5ebe2244 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:50.096184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1359/2725] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:51.130490 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:51.132017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:51.211489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e2729-6a6d-4f81-b632-c35935c3cec2 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:51.216198 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:51.217296 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:51.217585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:51.217863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] PATH_INFO: `/v3/users/61b9e26c9b594a1f9433862e3b12494d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:51.219066 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b9e26c9b594a1f9433862e3b12494d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:51.221027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:51.272640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b9e26c9b594a1f9433862e3b12494d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.273307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b9e26c9b594a1f9433862e3b12494d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.281403 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b9e26c9b594a1f9433862e3b12494d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.282454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b9e26c9b594a1f9433862e3b12494d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.292228 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b9e26c9b594a1f9433862e3b12494d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.312439 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1367/2726] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:51 2022] DELETE /identity/v3/users/61b9e26c9b594a1f9433862e3b12494d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:51.316993 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:51.317510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:51.317727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:51.336103 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:51.337316 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:51.405172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1360/2727] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:51.411544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:51.412970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:51.482835 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa7472-6216-4074-b595-d53b08f4642d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:51.486970 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:51.487914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:51.488202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:51.488482 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:51.500304 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:51.500799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:51.507758 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:51.525199 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1368/2728] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:51.820791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:51.822283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:51.834684 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dbcc6-d171-49f7-8a71-f8c0969cf9f6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:51.839354 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:51.840219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:51.840507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:51.840788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] PATH_INFO: `/v3/projects/e090c3043c3043f58011ef47468fc9a1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:51.842278 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e090c3043c3043f58011ef47468fc9a1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:51.844261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:51.892152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e090c3043c3043f58011ef47468fc9a1', 'request_id': 'req-2a3b49ad-544e-4395-8028-bf7ee1b0a078'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.898273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e090c3043c3043f58011ef47468fc9a1', 'request_id': 'req-2a3b49ad-544e-4395-8028-bf7ee1b0a078'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.904023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e090c3043c3043f58011ef47468fc9a1', 'request_id': 'req-2a3b49ad-544e-4395-8028-bf7ee1b0a078'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.917892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] The token cache is being invalidate because project e090c3043c3043f58011ef47468fc9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:51.918357 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.918981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:51.922045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1361/2729] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:51 2022] DELETE /identity/v3/projects/e090c3043c3043f58011ef47468fc9a1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:51.926126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:51.936885 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278e31-3d6b-48c9-a8a5-d7dbec7d89a7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:51.993227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:51.994098 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:51.994447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:51.994716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] PATH_INFO: `/v3/users/25cf37e8f5084262914f2ede29603d7e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:51.995939 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cf37e8f5084262914f2ede29603d7e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:51.998007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:52.048215 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cf37e8f5084262914f2ede29603d7e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.048874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cf37e8f5084262914f2ede29603d7e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.055779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cf37e8f5084262914f2ede29603d7e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.056427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cf37e8f5084262914f2ede29603d7e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.064123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cf37e8f5084262914f2ede29603d7e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.081280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1369/2730] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:51 2022] DELETE /identity/v3/users/25cf37e8f5084262914f2ede29603d7e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:52.364120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:52.365882 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:52.387535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b49ad-544e-4395-8028-bf7ee1b0a078 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:52.438954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:52.453574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:52.454472 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:52.454766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:52.455049 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] PATH_INFO: `/v3/projects/6b6234c3e0074aaabb30643446efc301` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:52.456347 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6234c3e0074aaabb30643446efc301)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:52.458280 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:52.505522 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6234c3e0074aaabb30643446efc301', 'request_id': 'req-2d0e3b82-79fd-40d3-833e-bb3c749b258d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.511875 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6234c3e0074aaabb30643446efc301', 'request_id': 'req-2d0e3b82-79fd-40d3-833e-bb3c749b258d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.517761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6234c3e0074aaabb30643446efc301', 'request_id': 'req-2d0e3b82-79fd-40d3-833e-bb3c749b258d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.530416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] The token cache is being invalidate because project 6b6234c3e0074aaabb30643446efc301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:52.530711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.531377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.532929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1362/2731] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:52 2022] DELETE /identity/v3/projects/6b6234c3e0074aaabb30643446efc301 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:52.537159 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:52.538577 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:52.552133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb763faa-48d8-42ef-b56e-41f1abe4d1eb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:52.611209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:52.612017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:52.612305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:52.612583 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] PATH_INFO: `/v3/users/995af9a06d774247a351e82cea3f71be` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:52.613775 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=995af9a06d774247a351e82cea3f71be)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:52.615769 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:52.639103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:52.665600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995af9a06d774247a351e82cea3f71be'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.666250 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995af9a06d774247a351e82cea3f71be'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.674050 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995af9a06d774247a351e82cea3f71be'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.674708 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995af9a06d774247a351e82cea3f71be'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.682071 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1bc6a4-4656-4603-83d3-d5dae4879bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995af9a06d774247a351e82cea3f71be'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:52.700139 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1370/2732] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:52 2022] DELETE /identity/v3/users/995af9a06d774247a351e82cea3f71be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:52.999601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.001738 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:53.017623 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3b82-79fd-40d3-833e-bb3c749b258d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.095511 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.096386 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.096681 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.096968 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] PATH_INFO: `/v3/projects/6e2a8d2ca981435baa56d987bc260bfe` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.098169 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2a8d2ca981435baa56d987bc260bfe)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.100124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.148557 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2a8d2ca981435baa56d987bc260bfe', 'request_id': 'req-bbd25a07-cb95-428e-9c9d-5049fcb9df15'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:53.155432 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2a8d2ca981435baa56d987bc260bfe', 'request_id': 'req-bbd25a07-cb95-428e-9c9d-5049fcb9df15'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:53.161227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2a8d2ca981435baa56d987bc260bfe', 'request_id': 'req-bbd25a07-cb95-428e-9c9d-5049fcb9df15'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:53.177306 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] The token cache is being invalidate because project 6e2a8d2ca981435baa56d987bc260bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:53.177606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:53.178262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bbd25a07-cb95-428e-9c9d-5049fcb9df15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:53.180660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1363/2733] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:52 2022] DELETE /identity/v3/projects/6e2a8d2ca981435baa56d987bc260bfe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:53.186625 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.186894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.187281 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.206522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:53.208106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:53.291197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1371/2734] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:53.294622 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.294956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.295355 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.309384 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:53.317344 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:53.319780 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:53.329281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1364/2735] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:53.333722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.344436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2732-8100-4144-99f1-36f4ca487d0e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.349070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.349742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.350145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.350442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.355436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:53.358514 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.360587 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.377414 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1372/2736] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:53.383942 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.394976 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604a73-2f80-453c-a30e-537f51442a16 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.399820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.400474 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.400761 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.401038 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.401726 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.404290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.432953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1365/2737] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:53 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:53.437945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.449096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8311f3-ad3b-4224-80c3-eef3b2187af6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.511487 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.512179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.512470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.512754 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.514057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.516279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.539344 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1373/2738] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:53 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:53.543273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.553786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e2a6-60dc-4e71-b3af-a501bebb54de admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.558685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.559412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.560410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.560572 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.561339 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.562937 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.576546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1366/2739] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:53.578078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.588621 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3f40-5392-44f8-a142-843372e91ce1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.594418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f9fa2-189d-4414-974e-c9688d04c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.595260 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f9fa2-189d-4414-974e-c9688d04c875 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.595551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f9fa2-189d-4414-974e-c9688d04c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.595824 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f9fa2-189d-4414-974e-c9688d04c875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.596551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f9fa2-189d-4414-974e-c9688d04c875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.598141 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f9fa2-189d-4414-974e-c9688d04c875 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.612549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1374/2740] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:53.613621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.623481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e5082-f718-4d75-8b1e-cebf9693e49c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.628449 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.629327 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.629608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.629889 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] PATH_INFO: `/v3/projects/4275e360373049f996bc3679e7f921a3/users/ac5ab9cfa5d346b08a2c9070656fa62a/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.646319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4275e360373049f996bc3679e7f921a3, user_id=ac5ab9cfa5d346b08a2c9070656fa62a, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.649468 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.664282 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1367/2741] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:53 2022] PUT /identity/v3/projects/4275e360373049f996bc3679e7f921a3/users/ac5ab9cfa5d346b08a2c9070656fa62a/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:53.670968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c2c6-1fbc-4654-8c1d-eae562cc5328 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.671293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c2c6-1fbc-4654-8c1d-eae562cc5328 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.671582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c2c6-1fbc-4654-8c1d-eae562cc5328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.678614 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:53.691503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e913c2c6-1fbc-4654-8c1d-eae562cc5328 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:53.693777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e913c2c6-1fbc-4654-8c1d-eae562cc5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:53.757715 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1375/2742] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:53.768749 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:53.770470 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:53.833714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bd19-96a5-43b3-9b90-db76c7529fa0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:53.837698 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:53.838426 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:53.838736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:53.839015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:53.850659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:53.852156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:53.862256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1368/2743] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:54.497036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:54.497326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:54.497654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:54.525314 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] MFA Rules not processed for user `ac5ab9cfa5d346b08a2c9070656fa62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:54.526536 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:54.597095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1376/2744] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:54.608608 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:54.610227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:54.673769 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db975-33d8-441e-8cbd-0d20d696e854 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:54.677541 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1f03-7344-4685-b1cc-3725eb4156e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:54.678142 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1f03-7344-4685-b1cc-3725eb4156e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:54.678431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1f03-7344-4685-b1cc-3725eb4156e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:54.678712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1f03-7344-4685-b1cc-3725eb4156e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:54.688549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1f03-7344-4685-b1cc-3725eb4156e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:54.690008 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1f03-7344-4685-b1cc-3725eb4156e2 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:54.699641 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1369/2745] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:54.907257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:54.908672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:54.923339 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d283-c29a-4094-8d36-f92ca3420404 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:54.928289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:54.929188 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:54.929597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:54.930090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] PATH_INFO: `/v3/users/055590d45612491cb57e12b3b4947435` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:54.931416 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055590d45612491cb57e12b3b4947435)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:54.933593 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:55.009589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055590d45612491cb57e12b3b4947435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.009589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055590d45612491cb57e12b3b4947435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.011931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055590d45612491cb57e12b3b4947435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.012601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055590d45612491cb57e12b3b4947435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.021354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055590d45612491cb57e12b3b4947435'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.048777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1377/2746] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:54 2022] DELETE /identity/v3/users/055590d45612491cb57e12b3b4947435 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:55.054313 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:55.055649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:55.055948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:55.074018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:55.075925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:55.124232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:55.143840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1370/2747] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:55.153493 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:55.155759 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:55.166105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:55.218191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86147307-a767-4ec7-8aab-ba3b8f251ab7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:55.221950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:55.222596 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:55.222879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:55.223176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:55.232916 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:55.234346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:55.244160 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1378/2748] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:55.515421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:55.516862 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:55.531341 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bad3d-de12-4e1d-a92a-fadabf6bc31c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:55.536635 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:55.537567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:55.537928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:55.538218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] PATH_INFO: `/v3/projects/6f4408f79f0a4c798ea892c7d77cc4d7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:55.539481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4408f79f0a4c798ea892c7d77cc4d7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:55.541428 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:55.590688 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4408f79f0a4c798ea892c7d77cc4d7', 'request_id': 'req-52305594-ac4a-4933-b789-c38e60e249ca'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.597887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4408f79f0a4c798ea892c7d77cc4d7', 'request_id': 'req-52305594-ac4a-4933-b789-c38e60e249ca'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.603720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4408f79f0a4c798ea892c7d77cc4d7', 'request_id': 'req-52305594-ac4a-4933-b789-c38e60e249ca'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.617018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] The token cache is being invalidate because project 6f4408f79f0a4c798ea892c7d77cc4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:55.617631 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.617933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.619548 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1371/2749] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:55 2022] DELETE /identity/v3/projects/6f4408f79f0a4c798ea892c7d77cc4d7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:55.624158 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:55.633966 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d98c62-89b7-49ff-9288-0f0207174add service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:55.692436 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:55.693311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:55.693597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:55.693879 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] PATH_INFO: `/v3/users/47be0d041ef7419eb5d899416230bd75` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:55.695061 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47be0d041ef7419eb5d899416230bd75)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:55.697016 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:55.744541 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47be0d041ef7419eb5d899416230bd75'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.745367 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47be0d041ef7419eb5d899416230bd75'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.752609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47be0d041ef7419eb5d899416230bd75'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.753249 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47be0d041ef7419eb5d899416230bd75'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.759700 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6b5e4ec-d975-4014-9967-3474c77e8fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47be0d041ef7419eb5d899416230bd75'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:55.777675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1379/2750] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:21:55 2022] DELETE /identity/v3/users/47be0d041ef7419eb5d899416230bd75 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:56.061161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.062811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:56.075161 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cb04e-9d5a-49f4-b09f-ab37481e4efa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.075639 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cb04e-9d5a-49f4-b09f-ab37481e4efa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.076069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cb04e-9d5a-49f4-b09f-ab37481e4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.081414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305594-ac4a-4933-b789-c38e60e249ca admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.094110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-465cb04e-9d5a-49f4-b09f-ab37481e4efa None None] MFA Rules not processed for user `ac5ab9cfa5d346b08a2c9070656fa62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:56.095412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-465cb04e-9d5a-49f4-b09f-ab37481e4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:56.122803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.147381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.148249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.148534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.148815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] PATH_INFO: `/v3/projects/5d25f90e4b1d4df98b4b61ea7eca2839` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.149992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d25f90e4b1d4df98b4b61ea7eca2839)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.151973 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.158575 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1380/2751] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:56.207523 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d25f90e4b1d4df98b4b61ea7eca2839', 'request_id': 'req-f945014f-4fb8-48df-af2a-e122f7fdd3c7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:56.214597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d25f90e4b1d4df98b4b61ea7eca2839', 'request_id': 'req-f945014f-4fb8-48df-af2a-e122f7fdd3c7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:56.222043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d25f90e4b1d4df98b4b61ea7eca2839', 'request_id': 'req-f945014f-4fb8-48df-af2a-e122f7fdd3c7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:56.237230 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] The token cache is being invalidate because project 5d25f90e4b1d4df98b4b61ea7eca2839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:21:56.237675 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:56.238256 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f945014f-4fb8-48df-af2a-e122f7fdd3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:21:56.240193 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1372/2752] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:21:56 2022] DELETE /identity/v3/projects/5d25f90e4b1d4df98b4b61ea7eca2839 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:56.245094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.245385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.245663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.266185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:56.267427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:56.328582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1381/2753] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:21:56.336321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.336621 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.336907 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.344104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.360381 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:56.361770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:56.370435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1373/2754] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:56.375364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.385771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03fae-d737-4bc0-8da1-1fafcda86812 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.392167 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.392839 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.393126 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.393409 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.394145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:21:56.394458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.396105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.412642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1382/2755] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:21:56.413853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.430159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae0eb2-d5a8-4160-a8bc-f4963aa66768 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.436212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.436892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.437184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.437467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.438159 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.440130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.480866 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1374/2756] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:56 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:56.485225 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.496156 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81b93-2aaf-4691-adfc-f0cf50a626e1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.558936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.559584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.560637 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.560947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.561694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.563655 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.585595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1383/2757] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:56 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:21:56.589655 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.601161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ce68-8889-4586-aeb8-c3fa1df1dc1b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.606168 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.607794 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.607955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.608245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.608988 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.610618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.624868 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1375/2758] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:21:56.626019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.636224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c1ab-8896-49f7-ae08-5969d18732f1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.642670 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24b088-fd72-4c2b-9bc5-06e16fcb34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.643411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b088-fd72-4c2b-9bc5-06e16fcb34fe admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.643860 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b088-fd72-4c2b-9bc5-06e16fcb34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.644127 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b088-fd72-4c2b-9bc5-06e16fcb34fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.644865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24b088-fd72-4c2b-9bc5-06e16fcb34fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.646734 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24b088-fd72-4c2b-9bc5-06e16fcb34fe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.657686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1384/2759] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:21:56.661804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.673418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8966873-a3ca-41c8-bc1f-2fa1deeac653 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.678245 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.679164 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.679450 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.679725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] PATH_INFO: `/v3/projects/0901c6d946f84bac8924d4ba9dea7547/users/d95630d77aad42b19bb88fd526baa24e/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.695859 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0901c6d946f84bac8924d4ba9dea7547, user_id=d95630d77aad42b19bb88fd526baa24e, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.698527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.714348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1376/2760] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:56 2022] PUT /identity/v3/projects/0901c6d946f84bac8924d4ba9dea7547/users/d95630d77aad42b19bb88fd526baa24e/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:56.720784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18f863-a4a1-4f28-afed-fa9d790cf5e6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.721075 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18f863-a4a1-4f28-afed-fa9d790cf5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.721358 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18f863-a4a1-4f28-afed-fa9d790cf5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.740993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9c18f863-a4a1-4f28-afed-fa9d790cf5e6 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:56.742205 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9c18f863-a4a1-4f28-afed-fa9d790cf5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:56.778634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.808505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1385/2761] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:56.818800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:56.820628 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:56.880229 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b37c2-faa2-4721-98cd-8d14d98ad5d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:56.884054 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:56.884706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:56.885002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:56.885290 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:56.894620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:56.896102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:56.906107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1377/2762] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:21:57.557840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:57.558152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:57.558437 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:57.585896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] MFA Rules not processed for user `d95630d77aad42b19bb88fd526baa24e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:57.587026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:57.656533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1386/2763] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:57.661031 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:57.671578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51917-6ac9-46c0-8566-ced7789ae686 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:57.676255 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:57.676911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:57.677202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:57.677487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:57.678189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:57.680177 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:57.709490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1378/2764] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:21:57 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:57.713666 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:57.726373 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde93fc-8cfe-4276-bf91-7095d098c69f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:57.795630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:57.796171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:57.796461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:57.796749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:57.797460 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:57.799425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:57.827300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1387/2765] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:21:57 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:21:57.828797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:57.839257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2659e-e99e-41ff-9d82-c39beee28151 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:57.845068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:57.845836 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:57.846197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:57.846553 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:57.847529 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:57.849330 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:57.860539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1379/2766] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:57.864678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:57.875315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7516ff-520e-431c-b0de-1ec500f90a06 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:57.880023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:57.880910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:57.881189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:57.881598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] PATH_INFO: `/v3/projects/526a2c0ac9694904a88eae31d4f5b0bf/users/6888fd35e0104e9d9cbb9826ccdd0a94/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:57.901849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=526a2c0ac9694904a88eae31d4f5b0bf, user_id=6888fd35e0104e9d9cbb9826ccdd0a94, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:57.905163 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:57.918628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1388/2767] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:57 2022] PUT /identity/v3/projects/526a2c0ac9694904a88eae31d4f5b0bf/users/6888fd35e0104e9d9cbb9826ccdd0a94/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:21:57.923948 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:57.934028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0133c6-80d7-486f-824d-b0e38c36a95e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:57.989570 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc2d69-de70-4872-9ef2-4102a3016897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:57.990241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2d69-de70-4872-9ef2-4102a3016897 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:57.990535 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2d69-de70-4872-9ef2-4102a3016897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:57.990816 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2d69-de70-4872-9ef2-4102a3016897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:57.991581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc2d69-de70-4872-9ef2-4102a3016897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:57.993188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc2d69-de70-4872-9ef2-4102a3016897 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:58.002917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1380/2768] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:21:58.007038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:58.018254 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ef9a5-71e4-476f-838f-996b199bce0b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:58.022965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:58.023880 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:58.024169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:58.024451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] PATH_INFO: `/v3/projects/526a2c0ac9694904a88eae31d4f5b0bf/users/6888fd35e0104e9d9cbb9826ccdd0a94/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:58.032302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526a2c0ac9694904a88eae31d4f5b0bf, user_id=6888fd35e0104e9d9cbb9826ccdd0a94, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:58.032302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:58.041103 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1389/2769] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:21:58 2022] PUT /identity/v3/projects/526a2c0ac9694904a88eae31d4f5b0bf/users/6888fd35e0104e9d9cbb9826ccdd0a94/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:21:58.701083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:58.702080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:58.702581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:58.711758 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:58.736595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] MFA Rules not processed for user `6888fd35e0104e9d9cbb9826ccdd0a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:21:58.738421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:58.835225 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1381/2770] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:21:58.847361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:21:58.850062 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:21:58.885823 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:58.939711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aff59-a5c0-41b8-8673-95b5d0b32439 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:21:58.944544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:21:58.948024 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:21:58.948498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:21:58.948952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:21:59.016609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:21:59.018058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:21:59.027238 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1390/2771] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:21:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:00.370205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:00.371701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:00.383712 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8aec-d0c6-4138-a51e-0d5228750c03 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:00.387284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c6ce6-2145-4844-bd27-0d73d549f2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:00.388524 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c6ce6-2145-4844-bd27-0d73d549f2ae service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:00.388813 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c6ce6-2145-4844-bd27-0d73d549f2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:00.389131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c6ce6-2145-4844-bd27-0d73d549f2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:00.398379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c6ce6-2145-4844-bd27-0d73d549f2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:00.399852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c6ce6-2145-4844-bd27-0d73d549f2ae service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:00.409811 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1382/2772] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:09.022833 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=38 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:10.405584 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=38 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:11.219415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:11.219415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:11.305826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181597-31d7-49e2-812b-d6196ef4638c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:11.313546 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:11.314531 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:11.314818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:11.315111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] PATH_INFO: `/v3/users/8b1010b5cc634e0bbedf0494de1477a8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:11.316391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1010b5cc634e0bbedf0494de1477a8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:11.318394 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:11.366178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1010b5cc634e0bbedf0494de1477a8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.366947 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1010b5cc634e0bbedf0494de1477a8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.374510 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1010b5cc634e0bbedf0494de1477a8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.375189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1010b5cc634e0bbedf0494de1477a8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.382748 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1010b5cc634e0bbedf0494de1477a8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.401322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1391/2773] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:22:11 2022] DELETE /identity/v3/users/8b1010b5cc634e0bbedf0494de1477a8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:11.406233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:11.406763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:11.406867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:11.424732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:11.425934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:11.488036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1383/2774] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:11.497847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:11.499226 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:11.559388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a44e76-fbdd-494c-9c60-5df96cc815e7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:11.564132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702c56c-850e-421b-b981-18e04a330426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:11.564791 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c56c-850e-421b-b981-18e04a330426 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:11.565079 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c56c-850e-421b-b981-18e04a330426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:11.565356 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c56c-850e-421b-b981-18e04a330426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:11.575852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c56c-850e-421b-b981-18e04a330426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:11.577332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c56c-850e-421b-b981-18e04a330426 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:11.587385 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1392/2775] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:22:11.863310 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:11.864800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:11.881498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe9ab6-8e2c-492b-84e8-fc962748495f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:11.886244 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:11.887138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:11.887467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:11.887789 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] PATH_INFO: `/v3/projects/993ea5ded54d4522a246ea3eb001af97` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:11.889033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=993ea5ded54d4522a246ea3eb001af97)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:11.891324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:11.939625 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993ea5ded54d4522a246ea3eb001af97', 'request_id': 'req-0d1de203-143f-4caf-bfab-1ab577c91413'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.945677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993ea5ded54d4522a246ea3eb001af97', 'request_id': 'req-0d1de203-143f-4caf-bfab-1ab577c91413'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.951576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993ea5ded54d4522a246ea3eb001af97', 'request_id': 'req-0d1de203-143f-4caf-bfab-1ab577c91413'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.964860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] The token cache is being invalidate because project 993ea5ded54d4522a246ea3eb001af97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:22:11.965199 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.966490 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0d1de203-143f-4caf-bfab-1ab577c91413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:11.968797 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1384/2776] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:22:11 2022] DELETE /identity/v3/projects/993ea5ded54d4522a246ea3eb001af97 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:11.974136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:11.974447 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:11.974726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:11.993232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:11.994512 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:12.011451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:12.063615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1393/2777] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:12.071815 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.072588 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.072922 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.092120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:12.093340 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:12.104888 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1385/2778] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:12.106251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.116834 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68858e01-248b-4fd8-9885-704b29bc3a2b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.121594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.122382 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.122678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.122938 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.123696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:22:12.124010 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.125626 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.137920 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1394/2779] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:22:12.142465 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.152467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b1c01-bb78-4c16-884f-75fabb234d8f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.158184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.158879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.159197 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.159481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.160194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.162117 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.192263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1386/2780] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:22:12 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:12.196790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.211664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41824d-160d-45ea-8e50-869682113c8f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.281751 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.282746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.283109 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.283600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.284704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.287176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.311900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1395/2781] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:22:12 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:12.316095 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.328023 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dd464-720e-4f96-a425-2bdf2e70f84c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.333292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.334005 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.334298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.334580 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.335379 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.336979 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.348727 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1387/2782] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:12.353219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.367427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe53528-4659-4c89-9ead-68b3e8240892 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.373026 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe72fcb-f2c1-43f6-97d4-e8d59b2f110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.373707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe72fcb-f2c1-43f6-97d4-e8d59b2f110f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.373993 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe72fcb-f2c1-43f6-97d4-e8d59b2f110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.374274 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe72fcb-f2c1-43f6-97d4-e8d59b2f110f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.375012 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe72fcb-f2c1-43f6-97d4-e8d59b2f110f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.376646 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe72fcb-f2c1-43f6-97d4-e8d59b2f110f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.395978 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1396/2783] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:12.397152 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.410072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faea27-6118-47e2-9874-f48c3bdfc664 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.415227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.416141 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.416431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.416716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] PATH_INFO: `/v3/projects/96bf20387ac24af6b192f071460b9056/users/d836530b3a0c47d287c57ae3915d4371/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.436827 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bf20387ac24af6b192f071460b9056, user_id=d836530b3a0c47d287c57ae3915d4371, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.439575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.455576 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1388/2784] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:12 2022] PUT /identity/v3/projects/96bf20387ac24af6b192f071460b9056/users/d836530b3a0c47d287c57ae3915d4371/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:12.461804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.462305 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.462846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.487778 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:12.489017 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:12.560463 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1397/2785] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:22:12.571748 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:12.573538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:12.599003 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:12.641161 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50264c-6c69-460a-880e-8efe5f06b3fe admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:12.654138 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0758d71-fd9c-488d-b5ad-0062398bd163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:12.654834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0758d71-fd9c-488d-b5ad-0062398bd163 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:12.655150 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0758d71-fd9c-488d-b5ad-0062398bd163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:12.655464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0758d71-fd9c-488d-b5ad-0062398bd163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:12.665624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0758d71-fd9c-488d-b5ad-0062398bd163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:12.667107 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0758d71-fd9c-488d-b5ad-0062398bd163 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:12.679001 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1389/2786] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:17.692443 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:17.694811 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:17.714370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:17.715817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:17.716784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:17.750496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] MFA Rules not processed for user `d836530b3a0c47d287c57ae3915d4371`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:17.753652 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:17.762934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:17.852615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764b9ee-bc9c-4508-87d0-e5a7ee353714 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:17.859423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:17.860090 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:17.860525 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:17.861365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:17.862867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:17.864840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1390/2787] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:22:17.869370 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:17.878681 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:17.880660 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:17.882711 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62b36-fa44-456b-b3d8-90ec1f2b0277 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:17.892830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1398/2788] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:17.906173 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:17.906992 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:17.907404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:17.907784 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:17.908930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:17.913376 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:17.968869 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1391/2789] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:22:17 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:22:17.969576 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:17.980856 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5dde2-cf67-49cb-be06-9664440b2cf1 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:18.086248 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:18.088668 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:18.089105 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:18.089499 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:18.090840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:18.097172 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:18.135359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1399/2790] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:22:17 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:22:18.138123 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:18.165512 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301c4e-4781-4498-b1e9-d3106017d079 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:18.171841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:18.172710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:18.173105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:18.173543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:18.175938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:18.177941 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:18.197063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1392/2791] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:18.200980 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:18.215120 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757f8c-28aa-45ff-a58c-d5369eda858a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:18.220737 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:18.221851 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:18.222826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:18.222826 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] PATH_INFO: `/v3/projects/53b1a63b30224e859b4adadd17c70715/users/30e8ceaeee94430dad58ead15a0fc934/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:18.239794 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b1a63b30224e859b4adadd17c70715, user_id=30e8ceaeee94430dad58ead15a0fc934, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:18.242844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:18.269522 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1400/2792] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:18 2022] PUT /identity/v3/projects/53b1a63b30224e859b4adadd17c70715/users/30e8ceaeee94430dad58ead15a0fc934/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:22:18.272081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:18.293959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12211-047e-4eec-a642-5d2d2d277bfc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:18.368299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:18.368929 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:18.370382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:18.370683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:18.371478 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:18.373431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:18.385596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1393/2793] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:18.390371 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:18.404224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a19d5-a8cb-45b6-a154-171b21b028c2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:18.409720 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:18.410795 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:18.411197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:18.411549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] PATH_INFO: `/v3/projects/53b1a63b30224e859b4adadd17c70715/users/30e8ceaeee94430dad58ead15a0fc934/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:18.413989 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b1a63b30224e859b4adadd17c70715, user_id=30e8ceaeee94430dad58ead15a0fc934, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:18.416838 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:18.442257 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1401/2794] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:18 2022] PUT /identity/v3/projects/53b1a63b30224e859b4adadd17c70715/users/30e8ceaeee94430dad58ead15a0fc934/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:18.521605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:18.523731 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:18.541077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e7b5d-9801-4821-aff4-107fd16b1e39 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:18.560910 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:18.638649 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:18.640218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:18.640724 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:18.641241 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] PATH_INFO: `/v3/users/d95630d77aad42b19bb88fd526baa24e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:18.642725 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95630d77aad42b19bb88fd526baa24e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:18.645198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:18.722382 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95630d77aad42b19bb88fd526baa24e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:18.736997 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95630d77aad42b19bb88fd526baa24e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:18.739953 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95630d77aad42b19bb88fd526baa24e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:18.766720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95630d77aad42b19bb88fd526baa24e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:18.768829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95630d77aad42b19bb88fd526baa24e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:18.785281 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1394/2795] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:22:18 2022] DELETE /identity/v3/users/d95630d77aad42b19bb88fd526baa24e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:19.070853 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:19.074214 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:19.089118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee710a-f464-47a5-a28d-08439d0f5b82 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:19.162332 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:19.178359 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:19.180013 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:19.180375 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:19.180725 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] PATH_INFO: `/v3/projects/0901c6d946f84bac8924d4ba9dea7547` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:19.182756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0901c6d946f84bac8924d4ba9dea7547)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:19.187611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:19.264038 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0901c6d946f84bac8924d4ba9dea7547', 'request_id': 'req-35db2d78-307e-48b9-8f94-52794742e1de'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.275366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0901c6d946f84bac8924d4ba9dea7547', 'request_id': 'req-35db2d78-307e-48b9-8f94-52794742e1de'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.283844 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0901c6d946f84bac8924d4ba9dea7547', 'request_id': 'req-35db2d78-307e-48b9-8f94-52794742e1de'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.297004 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] The token cache is being invalidate because project 0901c6d946f84bac8924d4ba9dea7547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:22:19.297365 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.298190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.300273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1402/2796] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:22:19 2022] DELETE /identity/v3/projects/0901c6d946f84bac8924d4ba9dea7547 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:19.304036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:19.317261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14881-f445-4efe-9880-c33cd43e79f6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:19.389679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:19.390885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:19.391269 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:19.391574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] PATH_INFO: `/v3/users/6888fd35e0104e9d9cbb9826ccdd0a94` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:19.393015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6888fd35e0104e9d9cbb9826ccdd0a94)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:19.395257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:19.459591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:19.476610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6888fd35e0104e9d9cbb9826ccdd0a94'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.494765 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6888fd35e0104e9d9cbb9826ccdd0a94'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.495798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6888fd35e0104e9d9cbb9826ccdd0a94'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.519464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6888fd35e0104e9d9cbb9826ccdd0a94'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.519464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1d4e9287-52fd-4526-aee8-a5960c5c6490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6888fd35e0104e9d9cbb9826ccdd0a94'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.535890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1395/2797] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:22:19 2022] DELETE /identity/v3/users/6888fd35e0104e9d9cbb9826ccdd0a94 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:19.757346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:19.759148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:19.783943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2d78-307e-48b9-8f94-52794742e1de admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:19.876763 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:19.877911 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:19.878284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:19.878598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] PATH_INFO: `/v3/projects/526a2c0ac9694904a88eae31d4f5b0bf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:19.879959 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526a2c0ac9694904a88eae31d4f5b0bf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:19.881944 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:19.928924 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082524b2-c0b8-4912-9d3d-826589f670e7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:19.934488 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082524b2-c0b8-4912-9d3d-826589f670e7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:19.934991 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082524b2-c0b8-4912-9d3d-826589f670e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:19.970172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-082524b2-c0b8-4912-9d3d-826589f670e7 None None] MFA Rules not processed for user `ac5ab9cfa5d346b08a2c9070656fa62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:19.974920 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-082524b2-c0b8-4912-9d3d-826589f670e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:19.978611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526a2c0ac9694904a88eae31d4f5b0bf', 'request_id': 'req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:19.998558 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526a2c0ac9694904a88eae31d4f5b0bf', 'request_id': 'req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:20.011265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526a2c0ac9694904a88eae31d4f5b0bf', 'request_id': 'req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:20.049560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] The token cache is being invalidate because project 526a2c0ac9694904a88eae31d4f5b0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:22:20.049903 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:20.050585 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0538a4ed-4685-4cdc-8ca9-c7bfc07ea133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:20.052342 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1403/2798] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:22:19 2022] DELETE /identity/v3/projects/526a2c0ac9694904a88eae31d4f5b0bf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:20.061388 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.061768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.062124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.091977 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:20.093377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:20.101420 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:20.137943 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1396/2799] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:20.179268 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1404/2800] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:20.187549 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.188106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.188808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.224802 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:20.226261 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:20.237568 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1397/2801] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:20.241489 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.254106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f1dd-8530-48e5-b5c2-43f8c1b3b246 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.260917 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.261649 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.261950 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.262790 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.263663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:22:20.263958 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.265906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.285615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1405/2802] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:22:20.289874 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.301202 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719e127-fe96-4437-894f-387cbd7d8df8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.307436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.308412 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.308867 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.310772 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.311709 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.314321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.359162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1398/2803] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:22:20 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:22:20.362968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.376435 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b88c09-6392-4615-9ec8-6779f0694d64 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.462352 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.463647 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.463846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.464084 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.464787 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.468270 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.501509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1406/2804] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:22:20 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:20.505685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.521104 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d813ec-8c24-4a6b-96d9-e843a3984132 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.537131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.537845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.538131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.538410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.539170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.540804 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.545830 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.549122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:20.596778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1399/2805] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 15:22:20.599430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.639273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed76b24-2e11-4c2b-acf9-77b267ef05ae admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.663685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.664759 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.665212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.665672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.666587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.669345 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.687079 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1400/2806] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:20.688521 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19ec8c-3094-498b-9d49-e689980a0837 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.692091 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.692594 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.693269 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.693739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.694028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.696534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:20.713551 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.715370 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25b80-976d-4cca-97d7-cd496fc8ca03 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.717644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6d4f-24b9-4c8d-ba09-e53079899b4e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:20.726124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:20.727040 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.727361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.727647 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] PATH_INFO: `/v3/projects/a0afced1d2134bb49eb305ae0371fbe6/users/3a7e6ced1ce8475a9ddabbe22fadc254/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.734122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1407/2807] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:20.751351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0afced1d2134bb49eb305ae0371fbe6, user_id=3a7e6ced1ce8475a9ddabbe22fadc254, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:20.754710 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:20.783476 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1401/2808] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:20 2022] PUT /identity/v3/projects/a0afced1d2134bb49eb305ae0371fbe6/users/3a7e6ced1ce8475a9ddabbe22fadc254/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:20.785719 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fff41-0d12-4aee-ab48-bbe1092ca61e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:20.786189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fff41-0d12-4aee-ab48-bbe1092ca61e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:20.786474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fff41-0d12-4aee-ab48-bbe1092ca61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:20.821589 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-797fff41-0d12-4aee-ab48-bbe1092ca61e None None] MFA Rules not processed for user `3a7e6ced1ce8475a9ddabbe22fadc254`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:20.822832 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-797fff41-0d12-4aee-ab48-bbe1092ca61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:20.875210 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:20.951036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1408/2809] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:20.963496 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:20.966213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:21.060404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:21.082081 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2b6e-59dd-4693-bbba-e026c932628c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:21.098854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:21.101964 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:21.103803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:21.104208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:21.123967 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:21.125849 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:21.141554 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1402/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:24.299870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208cdd2-49fa-4339-8d4f-2dbbeccd19b4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:24.300411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208cdd2-49fa-4339-8d4f-2dbbeccd19b4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:24.300411 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208cdd2-49fa-4339-8d4f-2dbbeccd19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:24.328407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0208cdd2-49fa-4339-8d4f-2dbbeccd19b4 None None] MFA Rules not processed for user `30e8ceaeee94430dad58ead15a0fc934`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:24.329619 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0208cdd2-49fa-4339-8d4f-2dbbeccd19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:24.403488 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1409/2811] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:24.416395 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:24.417857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:24.480295 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38a2b-43f7-4cf7-ade8-5c4747055a76 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:24.485113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fabeab62b09344859e4479dd227fc61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:24.485892 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:24.486213 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:24.486515 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:24.488855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:24.555015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:24.556486 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:24.566130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1403/2812] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:24.686919 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:24.687255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:24.687533 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:24.708968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:24.710177 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:24.782408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1410/2813] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:24.836195 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:24.837751 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:24.920591 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78802f2-23e4-4810-9b84-eea7f71652d8 service glance] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:24.927781 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cae0ef-5a76-4c1f-be7b-d54bbb06c799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:24.928506 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cae0ef-5a76-4c1f-be7b-d54bbb06c799 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:24.928807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cae0ef-5a76-4c1f-be7b-d54bbb06c799 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:24.929234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cae0ef-5a76-4c1f-be7b-d54bbb06c799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:24.939366 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cae0ef-5a76-4c1f-be7b-d54bbb06c799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:24.941041 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cae0ef-5a76-4c1f-be7b-d54bbb06c799 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:24.950864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1404/2814] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:22:30.712243 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:30.773140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:30.793803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017db22-9c0f-4d58-9694-6153581bdcb6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:30.798605 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:30.799554 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:30.799837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:30.800123 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] PATH_INFO: `/v3/users/3a7e6ced1ce8475a9ddabbe22fadc254` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:30.801354 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7e6ced1ce8475a9ddabbe22fadc254)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:30.803324 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:30.870682 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7e6ced1ce8475a9ddabbe22fadc254'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:30.872317 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7e6ced1ce8475a9ddabbe22fadc254'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:30.881545 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7e6ced1ce8475a9ddabbe22fadc254'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:30.882408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7e6ced1ce8475a9ddabbe22fadc254'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:30.910845 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7e6ced1ce8475a9ddabbe22fadc254'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:30.940579 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1411/2815] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:22:30 2022] DELETE /identity/v3/users/3a7e6ced1ce8475a9ddabbe22fadc254 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:30.944890 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:30.945399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:30.945514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:30.967122 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:30.968461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:30.998324 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:31.037136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1405/2816] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:31.052896 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:31.054386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:31.136584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f188c55-ceaa-4e9a-aa43-7161328e7674 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:31.140799 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19254f7f-1c72-44c2-b9bf-935d8b9feb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:31.141461 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19254f7f-1c72-44c2-b9bf-935d8b9feb26 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:31.141749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19254f7f-1c72-44c2-b9bf-935d8b9feb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:31.142029 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19254f7f-1c72-44c2-b9bf-935d8b9feb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:31.152145 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19254f7f-1c72-44c2-b9bf-935d8b9feb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:31.156679 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19254f7f-1c72-44c2-b9bf-935d8b9feb26 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:31.170190 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1412/2817] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:31.534399 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:31.536045 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:31.558270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5c242-9524-4fc8-a020-9bff50020c57 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:31.564706 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:31.565853 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:31.566212 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:31.566574 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] PATH_INFO: `/v3/projects/a0afced1d2134bb49eb305ae0371fbe6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:31.568075 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0afced1d2134bb49eb305ae0371fbe6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:31.571121 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:31.637176 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0afced1d2134bb49eb305ae0371fbe6', 'request_id': 'req-b984ebbc-7ac2-4e9a-931d-e46de2486816'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:31.644685 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0afced1d2134bb49eb305ae0371fbe6', 'request_id': 'req-b984ebbc-7ac2-4e9a-931d-e46de2486816'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:31.650209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0afced1d2134bb49eb305ae0371fbe6', 'request_id': 'req-b984ebbc-7ac2-4e9a-931d-e46de2486816'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:31.669477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] The token cache is being invalidate because project a0afced1d2134bb49eb305ae0371fbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:22:31.669876 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:31.670543 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b984ebbc-7ac2-4e9a-931d-e46de2486816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:31.672408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1406/2818] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:22:31 2022] DELETE /identity/v3/projects/a0afced1d2134bb49eb305ae0371fbe6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:31.677453 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:31.677746 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:31.678019 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:31.706212 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:31.707669 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:31.772442 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1413/2819] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:31.781387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:31.781808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:31.782208 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:31.806011 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:31.807682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:31.816401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1407/2820] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:22:31.820855 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:31.833580 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6178b-a5ea-4d14-9db1-6b452d293ee8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:31.838599 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:31.839369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:31.840025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:31.841569 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:31.842516 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:22:31.842890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:31.845030 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:31.847672 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:31.865311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1414/2821] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:22:31.866610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:31.877818 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf194d-ff49-4e88-ba6e-3e7960f48adf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:31.883218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:31.883886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:31.884207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:31.884487 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:31.885216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:31.888798 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:31.919606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1408/2822] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:22:31 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:31.924289 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:31.939313 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5846b-3d31-4ce6-9fb0-d67a579b99cf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.007022 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.008181 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.008567 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.008910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.009664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.011711 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.045534 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1415/2823] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:22:31 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:22:32.046735 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.058800 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b8fb-092e-4d44-ba45-b03fac78ca04 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.067763 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.068732 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.069210 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.069807 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.070841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.072510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.087975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1409/2824] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:32.092114 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.105117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37124af-7cff-4715-a75e-accc91c72279 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.111929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc8cc8-83fa-4250-9ff3-5a3bbb6eb572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.112606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8cc8-83fa-4250-9ff3-5a3bbb6eb572 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.112891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8cc8-83fa-4250-9ff3-5a3bbb6eb572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.113170 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8cc8-83fa-4250-9ff3-5a3bbb6eb572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.113965 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc8cc8-83fa-4250-9ff3-5a3bbb6eb572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.115663 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc8cc8-83fa-4250-9ff3-5a3bbb6eb572 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.129557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1416/2825] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:32.134072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.149233 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a99f-a6c9-47d8-a0dd-75f8b58572a3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.155946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.156801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.157090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.157552 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] PATH_INFO: `/v3/projects/967cd39472be4fbb85a1b930a40eb05f/users/64fb429f0bff45899387955a4f0f37c8/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.177454 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=967cd39472be4fbb85a1b930a40eb05f, user_id=64fb429f0bff45899387955a4f0f37c8, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.180320 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.199071 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1410/2826] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:32 2022] PUT /identity/v3/projects/967cd39472be4fbb85a1b930a40eb05f/users/64fb429f0bff45899387955a4f0f37c8/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:32.211189 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.211704 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.212176 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.251852 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] MFA Rules not processed for user `64fb429f0bff45899387955a4f0f37c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:32.253119 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:32.332887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1417/2827] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:32.337072 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.398112 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:32.418808 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae98db-300e-42c8-8880-0899770fe49d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.429461 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.430257 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.430606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.430963 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.431783 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.434536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.481860 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1411/2828] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:22:32 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:32.485874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.505994 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb42ea4-b3f5-4c1c-bda6-37629535ec57 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.617399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.618180 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.618468 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.618749 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.619936 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.623193 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.632232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:32.653803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1418/2829] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:22:32 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:32.655545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.671298 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd09ea-5de7-4b41-b4bb-0474844e1f97 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.679950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.680776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.681165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.681544 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.682394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.687996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.705504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1412/2830] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:32.707816 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.721484 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b76245-67a9-491c-9084-cf2052eac1ad admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.727894 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.729298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.729766 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.730233 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] PATH_INFO: `/v3/projects/d40c82a7818a4a62b2b8a05afacadf76/users/4df7333d7ea245efbb779ccfc10833fa/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.750783 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40c82a7818a4a62b2b8a05afacadf76, user_id=4df7333d7ea245efbb779ccfc10833fa, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.753804 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.780252 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1419/2831] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:32 2022] PUT /identity/v3/projects/d40c82a7818a4a62b2b8a05afacadf76/users/4df7333d7ea245efbb779ccfc10833fa/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:32.785464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.797898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb407-613e-4193-ba7c-57e9f48973c0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.902239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b601e6f-74d5-4e07-b8e2-9dc8fd915834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.904111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601e6f-74d5-4e07-b8e2-9dc8fd915834 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.904578 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601e6f-74d5-4e07-b8e2-9dc8fd915834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.905018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601e6f-74d5-4e07-b8e2-9dc8fd915834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.905975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b601e6f-74d5-4e07-b8e2-9dc8fd915834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.909198 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b601e6f-74d5-4e07-b8e2-9dc8fd915834 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.938164 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:32.939209 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1413/2832] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:32.951809 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbab24-8320-4b26-8cd1-c92deeaa5a94 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:32.956739 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:32.958003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.958298 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.958584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] PATH_INFO: `/v3/projects/d40c82a7818a4a62b2b8a05afacadf76/users/4df7333d7ea245efbb779ccfc10833fa/roles/1b534f74d3ee4742a18eb90532175f3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.960927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40c82a7818a4a62b2b8a05afacadf76, user_id=4df7333d7ea245efbb779ccfc10833fa, role_id=1b534f74d3ee4742a18eb90532175f3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:32.963874 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:32.990217 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c134-c785-4ace-ae4b-4745fdd56a1a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:32.990518 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c134-c785-4ace-ae4b-4745fdd56a1a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:32.990810 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c134-c785-4ace-ae4b-4745fdd56a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:32.992284 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1420/2833] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:32 2022] PUT /identity/v3/projects/d40c82a7818a4a62b2b8a05afacadf76/users/4df7333d7ea245efbb779ccfc10833fa/roles/1b534f74d3ee4742a18eb90532175f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:33.030321 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6043c134-c785-4ace-ae4b-4745fdd56a1a None None] MFA Rules not processed for user `4df7333d7ea245efbb779ccfc10833fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:33.031986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6043c134-c785-4ace-ae4b-4745fdd56a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:33.130131 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1414/2834] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:33.142986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:33.145432 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:33.248628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9ebd6-1961-40e8-8eb5-90bdd6c50734 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:33.257392 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:33.258183 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:33.258565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:33.258952 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:33.353756 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:33.356235 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:33.380422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1421/2835] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:35.349430 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3f5c-21e3-422a-8adb-6c3ba7ddda3a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:35.350124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3f5c-21e3-422a-8adb-6c3ba7ddda3a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:35.350124 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3f5c-21e3-422a-8adb-6c3ba7ddda3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:35.369840 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c3cf3f5c-21e3-422a-8adb-6c3ba7ddda3a None None] MFA Rules not processed for user `d836530b3a0c47d287c57ae3915d4371`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:35.371050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c3cf3f5c-21e3-422a-8adb-6c3ba7ddda3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:35.416954 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:35.433189 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1415/2836] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:36.221503 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:36.299343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f334-5ef7-4076-9d30-787fa12f8906 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:36.305146 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:36.306035 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:36.306400 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:36.306767 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] PATH_INFO: `/v3/users/64fb429f0bff45899387955a4f0f37c8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:36.308054 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fb429f0bff45899387955a4f0f37c8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:36.310272 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:36.325910 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:36.377377 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fb429f0bff45899387955a4f0f37c8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.378099 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fb429f0bff45899387955a4f0f37c8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.386662 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fb429f0bff45899387955a4f0f37c8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.388171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fb429f0bff45899387955a4f0f37c8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.399113 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fb429f0bff45899387955a4f0f37c8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.422859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1422/2837] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:22:36 2022] DELETE /identity/v3/users/64fb429f0bff45899387955a4f0f37c8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:36.427508 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:36.428019 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:36.428160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:36.448513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:36.450289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:36.516752 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1416/2838] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:36.526418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:36.528452 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:36.589343 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700daf6-356f-46e2-b7b4-e083300af66d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:36.594255 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:36.594900 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:36.595218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:36.595497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:36.597438 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:36.598809 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:36.605689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:36.607364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:36.617837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1423/2839] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:36.672550 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d616b82-06c4-4070-a5aa-57462f8ddcde None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:36.677835 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:36.678587 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:36.679043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:36.679352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:36.681144 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:36.700590 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:36.702380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:36.713365 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1417/2840] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:22:36.893495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:36.894991 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:36.908689 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815ce51-f937-4623-a11b-5fb1be6ddacd service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:36.915154 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:36.916023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:36.916307 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:36.916586 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] PATH_INFO: `/v3/projects/967cd39472be4fbb85a1b930a40eb05f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:36.919209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=967cd39472be4fbb85a1b930a40eb05f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:36.921196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:36.977187 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967cd39472be4fbb85a1b930a40eb05f', 'request_id': 'req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.985387 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967cd39472be4fbb85a1b930a40eb05f', 'request_id': 'req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:36.991847 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967cd39472be4fbb85a1b930a40eb05f', 'request_id': 'req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.003425 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] The token cache is being invalidate because project 967cd39472be4fbb85a1b930a40eb05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:22:37.003718 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.004372 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.005962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1424/2841] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:22:36 2022] DELETE /identity/v3/projects/967cd39472be4fbb85a1b930a40eb05f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:37.010102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:37.022037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180019b-1564-4a17-8300-7fc804d30358 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:37.081934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:37.082817 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:37.083130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:37.083408 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] PATH_INFO: `/v3/users/4df7333d7ea245efbb779ccfc10833fa` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:37.084596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df7333d7ea245efbb779ccfc10833fa)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:37.086555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:37.114175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:37.145109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df7333d7ea245efbb779ccfc10833fa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.152776 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df7333d7ea245efbb779ccfc10833fa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.153406 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df7333d7ea245efbb779ccfc10833fa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.167111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df7333d7ea245efbb779ccfc10833fa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.168551 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb9ffd91-a635-4e02-a220-6f91de17ddf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df7333d7ea245efbb779ccfc10833fa'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.191872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1418/2842] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:22:37 2022] DELETE /identity/v3/users/4df7333d7ea245efbb779ccfc10833fa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:37.545227 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:37.546796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:37.559914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b4e5f-f48f-40d3-9658-b0f9c270ddfc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:37.570340 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:37.628023 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:37.628934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:37.629231 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:37.629504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] PATH_INFO: `/v3/projects/d40c82a7818a4a62b2b8a05afacadf76` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:37.630694 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40c82a7818a4a62b2b8a05afacadf76)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:37.632634 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:37.682713 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40c82a7818a4a62b2b8a05afacadf76', 'request_id': 'req-e4514821-d656-41d6-8518-9bcb3896d92d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.692042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40c82a7818a4a62b2b8a05afacadf76', 'request_id': 'req-e4514821-d656-41d6-8518-9bcb3896d92d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.699288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40c82a7818a4a62b2b8a05afacadf76', 'request_id': 'req-e4514821-d656-41d6-8518-9bcb3896d92d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.712931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] The token cache is being invalidate because project d40c82a7818a4a62b2b8a05afacadf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:22:37.713280 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.713951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4514821-d656-41d6-8518-9bcb3896d92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:22:37.715789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1425/2843] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:22:37 2022] DELETE /identity/v3/projects/d40c82a7818a4a62b2b8a05afacadf76 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:37.720923 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:37.721479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:37.721838 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:37.741328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:37.742547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:37.842317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1419/2844] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:37.850150 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:37.850504 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:37.850777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:37.879300 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:37.880948 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:37.890818 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1426/2845] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:22:37.895383 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:37.907018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9e71-512c-43f9-a8c9-5c90480a4d2d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:37.912328 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:37.913002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:37.913292 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:37.913575 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:37.914526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:22:37.914766 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:37.916458 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:37.932744 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1420/2846] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:22:37.937171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:37.948349 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a100-20a4-41d7-bfd3-d42e6eec4917 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:37.953927 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26466a-40b2-494c-9daf-5f53c156cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:37.954696 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26466a-40b2-494c-9daf-5f53c156cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:37.954992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26466a-40b2-494c-9daf-5f53c156cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:37.955422 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26466a-40b2-494c-9daf-5f53c156cbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:37.956194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26466a-40b2-494c-9daf-5f53c156cbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:37.958171 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26466a-40b2-494c-9daf-5f53c156cbf3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:37.997069 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1427/2847] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:22:37 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 15:22:37.998352 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:38.009423 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518267f2-6dce-4bfe-a962-439312322320 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:38.105014 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.105309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.105632 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.106767 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:38.107597 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.107966 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.108175 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.108930 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:38.111018 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:38.129871 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:38.132173 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:38.138043 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1421/2848] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:22:37 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:22:38.143489 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:38.157510 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee1ab-e89b-4dfe-a227-ffd87daf6fd3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:38.166194 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:38.167058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.167393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.167672 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.168460 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:38.170861 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:38.188494 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1422/2849] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:38.192507 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:38.208805 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71fac6-d30f-459e-9966-a6ff89d213f3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:38.215402 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1428/2850] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:22:38.215577 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:38.216690 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.217028 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.218885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.219701 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:38.221520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:38.223666 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:38.235058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:38.239622 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:38.247483 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1423/2851] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:22:38.248601 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:38.261956 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2180821-b593-437d-95ea-ced6fb36d940 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:38.269183 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f56ec1-a2ef-477d-a175-c577f3782f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:38.270030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56ec1-a2ef-477d-a175-c577f3782f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.270319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56ec1-a2ef-477d-a175-c577f3782f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.270605 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56ec1-a2ef-477d-a175-c577f3782f4a admin admin] PATH_INFO: `/v3/projects/ef506c64b2d442d299e2eb16910be975/users/65439e25dc88400dac2c457aa5ed139e/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.292386 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:38.294007 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f56ec1-a2ef-477d-a175-c577f3782f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef506c64b2d442d299e2eb16910be975, user_id=65439e25dc88400dac2c457aa5ed139e, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:38.297302 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f56ec1-a2ef-477d-a175-c577f3782f4a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:38.334013 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1424/2852] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:22:38 2022] PUT /identity/v3/projects/ef506c64b2d442d299e2eb16910be975/users/65439e25dc88400dac2c457aa5ed139e/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:22:38.339063 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.339514 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.340435 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.365707 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:38.366984 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:38.393039 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec17833-7f2f-473c-a469-4f608154a140 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:38.466205 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1425/2853] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 15:22:38.479968 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2efa46-e139-4165-831e-7817a6c69a77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:38.481282 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2efa46-e139-4165-831e-7817a6c69a77 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.481636 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2efa46-e139-4165-831e-7817a6c69a77 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.481987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2efa46-e139-4165-831e-7817a6c69a77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.485502 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:38.487374 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:38.554125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2efa46-e139-4165-831e-7817a6c69a77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:38.557517 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2efa46-e139-4165-831e-7817a6c69a77 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:38.568021 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe225e6-ade2-4bbf-9fed-2d3cfddc82ad None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:38.571140 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1429/2854] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:22:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:22:38.572845 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:38.573410 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:38.573743 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:38.574027 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:38.585509 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:38.587034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:38.599844 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1426/2855] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:22:39.333785 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1cb1-085e-4c1f-8db7-a4ef313eb7bb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:39.334108 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1cb1-085e-4c1f-8db7-a4ef313eb7bb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:39.334418 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1cb1-085e-4c1f-8db7-a4ef313eb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:39.362633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5b6c1cb1-085e-4c1f-8db7-a4ef313eb7bb None None] MFA Rules not processed for user `65439e25dc88400dac2c457aa5ed139e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:39.364538 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5b6c1cb1-085e-4c1f-8db7-a4ef313eb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:39.481497 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:39.502096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1430/2856] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:39.518917 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:39.520431 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:39.651334 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001aef1-2148-45bc-8c85-ea9a232c2acf service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:39.655239 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:39.655938 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:39.656227 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:39.656513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:39.674420 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:39.675944 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:39.687618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1427/2857] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:41.213641 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669277f9-6beb-48b2-92be-fdc686b8fe3e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:41.214217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669277f9-6beb-48b2-92be-fdc686b8fe3e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:41.214217 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669277f9-6beb-48b2-92be-fdc686b8fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:41.233986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-669277f9-6beb-48b2-92be-fdc686b8fe3e None None] MFA Rules not processed for user `65439e25dc88400dac2c457aa5ed139e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:41.235202 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-669277f9-6beb-48b2-92be-fdc686b8fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:41.242294 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1431/2858] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:49.682491 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:51.227584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:52.414074 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:52.415791 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:52.562059 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a700-9a7d-4e22-b397-6692a75a2b61 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:52.573858 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:52.575271 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:52.575617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:52.575898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:52.580925 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:52.603533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:52.606848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:52.637413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1428/2859] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:22:59.512866 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0403d-2ecc-41ec-a435-e5f48dafd72d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:59.513412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0403d-2ecc-41ec-a435-e5f48dafd72d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:59.513412 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0403d-2ecc-41ec-a435-e5f48dafd72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:59.532505 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fdf0403d-2ecc-41ec-a435-e5f48dafd72d None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:22:59.533686 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fdf0403d-2ecc-41ec-a435-e5f48dafd72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:22:59.541003 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1432/2860] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:22:59.554728 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:22:59.566479 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb639e65-d828-4d98-96d2-8fd9ef1b1a58 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:22:59.571683 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:22:59.572329 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:22:59.572618 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:22:59.572898 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:22:59.582446 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:22:59.584077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:22:59.593915 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1429/2861] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:22:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:23:09.526537 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:09.589720 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=49 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:16.836321 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:16.836865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:16.836865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:16.855582 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:16.856788 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:16.864111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1433/2862] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:16.876911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:16.888162 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524d9c3-2ffa-42a2-a043-ae74280da903 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:16.893909 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:16.894573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:16.894864 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:16.895184 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:16.904495 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:16.906105 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:16.914284 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1430/2863] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:23:18.806929 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:18.809059 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:18.865416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:18.867596 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:18.892764 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90f19-2711-4572-9dfc-7e8496e255cb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:18.894163 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0ec1-233a-449c-89da-841c5bdca910 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:18.898326 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:18.898986 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:18.899309 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:18.899477 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:18.899615 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:18.900301 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:18.900645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:18.900934 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] PATH_INFO: `/v3/users/ac5ab9cfa5d346b08a2c9070656fa62a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:18.901571 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:18.902351 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5ab9cfa5d346b08a2c9070656fa62a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:18.904547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:18.913774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:18.915415 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:18.926182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1434/2864] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:23:18.960484 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5ab9cfa5d346b08a2c9070656fa62a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:18.969299 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5ab9cfa5d346b08a2c9070656fa62a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:18.969970 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5ab9cfa5d346b08a2c9070656fa62a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:18.983207 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5ab9cfa5d346b08a2c9070656fa62a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:18.983940 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dfcfe3a2-cd5a-4a44-95a3-8a1113dece05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5ab9cfa5d346b08a2c9070656fa62a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:18.996581 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1431/2865] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:23:18 2022] DELETE /identity/v3/users/ac5ab9cfa5d346b08a2c9070656fa62a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:23:19.176667 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.187863 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d4c1e-647e-4cf3-9c46-d20dbe849a63 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.251716 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.252495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.252782 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.253063 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] PATH_INFO: `/v3/projects/4275e360373049f996bc3679e7f921a3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.254240 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4275e360373049f996bc3679e7f921a3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.256191 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.306151 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4275e360373049f996bc3679e7f921a3', 'request_id': 'req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:19.314427 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4275e360373049f996bc3679e7f921a3', 'request_id': 'req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:19.321664 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4275e360373049f996bc3679e7f921a3', 'request_id': 'req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:19.336302 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] The token cache is being invalidate because project 4275e360373049f996bc3679e7f921a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:23:19.336584 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:19.337303 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5b4ae26f-7af5-45e6-9458-8a55118cc7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:19.339597 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1435/2866] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:23:19 2022] DELETE /identity/v3/projects/4275e360373049f996bc3679e7f921a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:23:19.344834 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.345132 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.345411 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.364090 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:19.365401 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:19.428234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1432/2867] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:19.437065 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.437364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.437771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.456870 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:19.458082 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:19.468055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1436/2868] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:19.472058 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.481679 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4dc9-3662-4951-92a4-37281d8a3340 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.486331 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.487037 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.487361 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.487644 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.488540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 15:23:19.488872 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.490642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.507234 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1433/2869] 10.222.0.45 () {58 vars in 1152 bytes} [Thu May 26 15:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 15:23:19.509203 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.519942 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304c05f-0234-4c9c-9a99-e29ff857c330 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.525186 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.525846 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.526133 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.526600 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.527613 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.529508 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.534731 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:19.562777 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1437/2870] 10.222.0.45 () {60 vars in 1152 bytes} [Thu May 26 15:23:19 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:23:19.567315 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.583157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae6ae9-52f0-4056-8627-b4fa9c1e819c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.634534 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:19.652160 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.653238 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.653567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.653851 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.654778 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.656855 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.683057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1434/2871] 10.222.0.45 () {60 vars in 1143 bytes} [Thu May 26 15:23:19 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 15:23:19.684470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.694905 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b40c2e-d17c-428d-8f17-c8ffdf0de402 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.701058 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.701774 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.702057 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.702334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.703070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.704703 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.715042 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1438/2872] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:23:19.719436 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.729716 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262ea2-e3cd-4a7d-b6ad-47167e3f466c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.737957 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.738660 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.738950 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.739279 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.740034 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.741682 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.753887 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1435/2873] 10.222.0.45 () {58 vars in 1121 bytes} [Thu May 26 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 15:23:19.759654 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.771837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e708-78d5-451a-a4d8-c641e880c916 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.778906 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3611b-8a5c-47f4-ba62-122c645ff3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.779840 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3611b-8a5c-47f4-ba62-122c645ff3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.780122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3611b-8a5c-47f4-ba62-122c645ff3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.780399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3611b-8a5c-47f4-ba62-122c645ff3aa admin admin] PATH_INFO: `/v3/projects/b7fa8cd6f5944d3d9e3ac1d8e6b73924/users/f61296c57f8643a3a1e8bacf33274c69/roles/0018fa725ee54f5dbe4d173e649d97e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.799598 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3611b-8a5c-47f4-ba62-122c645ff3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fa8cd6f5944d3d9e3ac1d8e6b73924, user_id=f61296c57f8643a3a1e8bacf33274c69, role_id=0018fa725ee54f5dbe4d173e649d97e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:19.802398 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3611b-8a5c-47f4-ba62-122c645ff3aa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:19.819397 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1439/2874] 10.222.0.45 () {60 vars in 1482 bytes} [Thu May 26 15:23:19 2022] PUT /identity/v3/projects/b7fa8cd6f5944d3d9e3ac1d8e6b73924/users/f61296c57f8643a3a1e8bacf33274c69/roles/0018fa725ee54f5dbe4d173e649d97e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:23:19.835467 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:19.837262 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:19.887923 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.888399 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.888786 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.905098 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c07a1-bf74-4231-b58c-c31c1ece0adc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:19.917890 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] MFA Rules not processed for user `f61296c57f8643a3a1e8bacf33274c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:19.919194 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:19.960645 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:19.961368 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:19.961663 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:19.961946 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:19.964539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:19.990675 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1440/2875] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:20.002362 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:20.004011 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:20.042387 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:20.044052 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ee30-2ccc-4da0-b724-1ccf8bd890ee service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:20.054630 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1436/2876] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:23:20.068002 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbfce7-10c0-4d5b-8ae5-14c19f2d0634 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:20.072005 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:20.072779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:20.073630 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:20.073914 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:20.083396 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:20.084837 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:20.097110 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1441/2877] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 15:23:21.500648 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:21.501232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:21.501232 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:21.529891 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] MFA Rules not processed for user `f61296c57f8643a3a1e8bacf33274c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:21.531171 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:21.538353 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1437/2878] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:29.602232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:29.613865 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804bcb6-a976-4628-a918-8f24deefa5e5 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:29.618000 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20eba02f87c74008b2fcb4c89c81df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:29.618650 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:29.618941 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:29.619265 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:29.621232 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:29.669676 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:29.689867 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:29.691379 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:29.701128 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1442/2879] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:23:31.523589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:39.696222 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:41.884589 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:41.886167 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:41.898617 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f587f5-e4f2-428a-ad4f-3e279a39f670 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:41.902263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:41.902903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:41.903270 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:41.903582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:41.905338 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:41.975803 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:41.977249 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ea237-f16f-4ff5-85ec-4bcb3d85702d service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:41.988998 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1438/2880] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:23:43.463940 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:43.474009 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4064a-01db-4f1a-8095-bbd6a87ee3b8 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:43.477733 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:43.478407 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:43.478742 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:43.479028 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:43.480971 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:43.495364 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:43.496889 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b15c2-a596-447d-8b8f-b631c8c23376 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:43.508067 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1443/2881] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:23:44.895546 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:44.896068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:44.896068 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:44.917093 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] MFA Rules not processed for user `e55884035fd3441583ece37dd8eb9248`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:44.918312 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:44.927416 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1439/2882] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:45.964279 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600674-b948-4ea8-822e-e87e896526d1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:45.964803 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600674-b948-4ea8-822e-e87e896526d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:45.965095 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600674-b948-4ea8-822e-e87e896526d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:46.039888 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f600674-b948-4ea8-822e-e87e896526d1 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:46.042476 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f600674-b948-4ea8-822e-e87e896526d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:46.119251 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1444/2883] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:46.144418 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:46.145879 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:46.240878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba4c3-062a-451a-8a7e-e21635deb649 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:46.246083 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:46.246736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:46.247025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:46.248119 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:46.256380 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:46.257989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:46.269400 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1440/2884] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:23:46.781771 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75963-2782-4064-8f4d-8d2aae368abc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:46.782070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75963-2782-4064-8f4d-8d2aae368abc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:46.782361 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75963-2782-4064-8f4d-8d2aae368abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:46.800875 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a9e75963-2782-4064-8f4d-8d2aae368abc None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:46.802107 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9e75963-2782-4064-8f4d-8d2aae368abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:46.810148 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1445/2885] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:46.821982 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:46.833526 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4efd2-0a6e-4104-8171-551bf61134d9 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:46.838878 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:46.839558 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:46.839852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:46.840136 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:46.848464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:46.850057 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:46.860317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1441/2886] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:23:47.120975 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b27d-69bf-4834-817b-0eddf246b005 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:47.121457 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b27d-69bf-4834-817b-0eddf246b005 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:47.121557 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b27d-69bf-4834-817b-0eddf246b005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:47.140094 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c5f2b27d-69bf-4834-817b-0eddf246b005 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:47.141334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c5f2b27d-69bf-4834-817b-0eddf246b005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:47.148987 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1446/2887] 10.222.0.45 () {58 vars in 1009 bytes} [Thu May 26 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:47.161033 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:47.172009 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54ad8-1e1d-4e57-b063-b32a48950a26 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:47.177870 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:47.178573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:47.178886 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:47.179211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:47.188504 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:47.190106 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:47.199172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1442/2888] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:23:47.566102 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:47.566391 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:47.566979 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:47.589117 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:47.590601 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:47.598698 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1447/2889] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:47.613373 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:47.629505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b1bb-1692-42a1-8faa-f83b35f8497d service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:47.636933 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3b8d2-a846-47f3-ac31-e7a7cb3f97d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:47.637606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b8d2-a846-47f3-ac31-e7a7cb3f97d6 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:47.637981 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b8d2-a846-47f3-ac31-e7a7cb3f97d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:47.638464 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3b8d2-a846-47f3-ac31-e7a7cb3f97d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:47.649036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3b8d2-a846-47f3-ac31-e7a7cb3f97d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:47.652204 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3b8d2-a846-47f3-ac31-e7a7cb3f97d6 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:47.667172 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1443/2890] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:23:49.939909 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:50.002604 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c483692-afbf-4eac-ae7d-0bc9d7eacba6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:50.006992 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:50.007893 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:50.008179 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:50.008458 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] PATH_INFO: `/v3/users/f61296c57f8643a3a1e8bacf33274c69` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:50.009642 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61296c57f8643a3a1e8bacf33274c69)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:50.011595 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:50.048334 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:50.061869 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61296c57f8643a3a1e8bacf33274c69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.062519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61296c57f8643a3a1e8bacf33274c69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.069322 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61296c57f8643a3a1e8bacf33274c69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.069945 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61296c57f8643a3a1e8bacf33274c69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.077327 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61296c57f8643a3a1e8bacf33274c69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.094273 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1448/2891] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:23:49 2022] DELETE /identity/v3/users/f61296c57f8643a3a1e8bacf33274c69 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:23:50.098829 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:50.099348 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:50.099452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:50.118086 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] MFA Rules not processed for user `6cc1f206a7534d478df8987147a33502`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:23:50.119996 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:50.124050 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:50.179332 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1444/2892] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:23:50.190089 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:50.191532 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:50.249726 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deaf78-327d-46dc-8693-c8dbd9248ad0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:50.253467 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:50.254055 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:50.254338 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:50.254616 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:50.264633 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:50.266118 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:50.276678 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1449/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:23:50.451006 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:23:50.452624 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:23:50.468714 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923377-7629-4df0-859f-4fc5bbe268cd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:23:50.482539 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:23:50.483463 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:23:50.483903 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:23:50.484191 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] PATH_INFO: `/v3/projects/b7fa8cd6f5944d3d9e3ac1d8e6b73924` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:23:50.485413 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fa8cd6f5944d3d9e3ac1d8e6b73924)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:23:50.487592 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:23:50.539498 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'request_id': 'req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.546801 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'request_id': 'req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.552263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'request_id': 'req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.564536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] The token cache is being invalidate because project b7fa8cd6f5944d3d9e3ac1d8e6b73924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:23:50.564826 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.565442 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:23:50.566975 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1445/2894] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:23:50 2022] DELETE /identity/v3/projects/b7fa8cd6f5944d3d9e3ac1d8e6b73924 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:24:00.271683 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=43,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:00.561650 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:14.106366 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:24:14.107807 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:14.131125 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746cf61-9816-4043-99e0-e224150106cd service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:24:14.182451 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:24:14.183196 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:24:14.183495 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:24:14.183779 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:24:14.185592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:14.249346 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:24:14.250796 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da727f-1761-46d6-9f1e-3030e4879e2a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:24:14.260951 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1450/2895] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:24:16.560969 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:24:16.562473 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:16.577130 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b742ff5-314d-4ba7-8380-0cbd3d8cf9ca admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:24:16.581289 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:24:16.582024 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:24:16.582437 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:24:16.583025 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:24:16.584691 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:16.596525 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:24:16.598120 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:24:16.611154 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1446/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:24:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:24:24.256192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=50 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:26.604002 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:32.957169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:24:32.957705 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:24:32.957984 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:24:32.975169 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] MFA Rules not processed for user `65439e25dc88400dac2c457aa5ed139e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:24:32.976369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:33.031470 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1451/2897] 10.222.0.45 () {58 vars in 957 bytes} [Thu May 26 15:24:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:24:33.576959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:24:33.578497 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:33.650770 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334b32-5802-43fd-9b5d-423543e40698 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:24:33.655873 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:24:33.656555 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:24:33.656848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:24:33.657157 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:24:33.658955 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:24:33.670848 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:24:33.672582 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:24:33.683273 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1447/2898] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:24:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:24:43.024768 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:43.678248 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=32 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:41.777197 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:25:41.778671 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:25:41.845723 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48a2e-11a2-4da6-b893-164b95cc87cf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:25:41.850175 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:25:41.851784 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:25:41.852073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:25:41.852351 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] PATH_INFO: `/v3/users/65439e25dc88400dac2c457aa5ed139e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:25:41.853543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65439e25dc88400dac2c457aa5ed139e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:25:41.855565 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:25:41.901643 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65439e25dc88400dac2c457aa5ed139e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:41.902293 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65439e25dc88400dac2c457aa5ed139e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:41.909369 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65439e25dc88400dac2c457aa5ed139e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:41.909998 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65439e25dc88400dac2c457aa5ed139e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:41.918073 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65439e25dc88400dac2c457aa5ed139e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:41.941735 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1452/2899] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:25:41 2022] DELETE /identity/v3/users/65439e25dc88400dac2c457aa5ed139e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:25:42.117500 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:25:42.133677 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78a56-8848-407d-bfc6-7b9baec74851 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:25:42.196545 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:25:42.197414 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:25:42.197705 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:25:42.197986 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] PATH_INFO: `/v3/projects/ef506c64b2d442d299e2eb16910be975` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:25:42.199242 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef506c64b2d442d299e2eb16910be975)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:25:42.201156 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:25:42.247469 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef506c64b2d442d299e2eb16910be975', 'request_id': 'req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:42.253620 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef506c64b2d442d299e2eb16910be975', 'request_id': 'req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:42.260190 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef506c64b2d442d299e2eb16910be975', 'request_id': 'req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:42.272538 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] The token cache is being invalidate because project ef506c64b2d442d299e2eb16910be975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:25:42.272830 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:42.273540 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:25:42.275134 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1448/2900] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:25:42 2022] DELETE /identity/v3/projects/ef506c64b2d442d299e2eb16910be975 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:25:51.937111 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:52.269485 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:26:46.799070 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:26:46.800692 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:26:46.891446 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b77e2-721a-422c-b711-29b6dd90c560 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:26:46.958218 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:26:46.958943 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:26:46.959266 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:26:46.959543 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:26:46.961390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:26:46.973224 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:26:46.975519 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:26:46.986025 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1453/2901] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:26:55.530626 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:26:55.532078 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:26:55.591607 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaed1f-6d7e-40da-b1f0-30932e0bfe4d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:26:55.595222 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:26:55.595911 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:26:55.596185 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:26:55.596462 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:26:55.598211 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:26:55.660680 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:26:55.662346 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:26:55.672283 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1449/2902] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:26:56.981606 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=62 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:01.995288 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:01.997096 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:02.019962 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04a81-d899-4bcf-8445-3e745e358334 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:02.025707 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:02.026611 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:02.026892 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:02.027207 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] PATH_INFO: `/v3/users/e55884035fd3441583ece37dd8eb9248` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:02.043640 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55884035fd3441583ece37dd8eb9248)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:02.047961 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:02.102464 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55884035fd3441583ece37dd8eb9248'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.103178 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55884035fd3441583ece37dd8eb9248'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.110469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55884035fd3441583ece37dd8eb9248'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.111136 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55884035fd3441583ece37dd8eb9248'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.118223 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55884035fd3441583ece37dd8eb9248'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.136124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1454/2903] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:27:01 2022] DELETE /identity/v3/users/e55884035fd3441583ece37dd8eb9248 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:27:02.310421 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:02.322377 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166576-ed32-4120-9016-7f4ea7a9b476 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:02.382036 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:02.382841 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:02.383165 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:02.383452 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] PATH_INFO: `/v3/projects/1da6b127a0d64f8892c4935ef08ed679` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:02.394174 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da6b127a0d64f8892c4935ef08ed679)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:02.396317 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:02.438404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:02.443453 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da6b127a0d64f8892c4935ef08ed679', 'request_id': 'req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.451393 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da6b127a0d64f8892c4935ef08ed679', 'request_id': 'req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.456884 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da6b127a0d64f8892c4935ef08ed679', 'request_id': 'req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.470102 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] The token cache is being invalidate because project 1da6b127a0d64f8892c4935ef08ed679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:27:02.470527 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.471372 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.473080 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1450/2904] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:27:02 2022] DELETE /identity/v3/projects/1da6b127a0d64f8892c4935ef08ed679 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:27:02.477473 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:02.478934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:02.493132 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81503081-c78b-48a4-9275-ef5da82f4b02 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:02.552192 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:02.553208 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:02.553491 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:02.553772 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] PATH_INFO: `/v3/users/875e56e37d91463a8c234eca64661b7f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:02.567506 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875e56e37d91463a8c234eca64661b7f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:02.570423 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:02.617041 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875e56e37d91463a8c234eca64661b7f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.617702 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875e56e37d91463a8c234eca64661b7f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.622329 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:02.625854 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875e56e37d91463a8c234eca64661b7f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.626806 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875e56e37d91463a8c234eca64661b7f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.635076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875e56e37d91463a8c234eca64661b7f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:02.652498 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1455/2905] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:27:02 2022] DELETE /identity/v3/users/875e56e37d91463a8c234eca64661b7f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:27:03.111547 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:03.113319 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:03.127434 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bcbb6-c99c-4079-a4a2-8fd15de3a497 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:03.186505 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:03.187407 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:03.187694 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:03.187971 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] PATH_INFO: `/v3/projects/f77dc1d8a7a04a96a7ce93e489e09fac` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:03.198768 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77dc1d8a7a04a96a7ce93e489e09fac)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:03.200736 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:03.246594 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77dc1d8a7a04a96a7ce93e489e09fac', 'request_id': 'req-d18fad1e-fa65-455a-96f9-516f9f6e7e87'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:03.254877 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77dc1d8a7a04a96a7ce93e489e09fac', 'request_id': 'req-d18fad1e-fa65-455a-96f9-516f9f6e7e87'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:03.260885 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77dc1d8a7a04a96a7ce93e489e09fac', 'request_id': 'req-d18fad1e-fa65-455a-96f9-516f9f6e7e87'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:03.274417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] The token cache is being invalidate because project f77dc1d8a7a04a96a7ce93e489e09fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:27:03.274713 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:03.275375 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d18fad1e-fa65-455a-96f9-516f9f6e7e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:03.277015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1451/2906] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:27:03 2022] DELETE /identity/v3/projects/f77dc1d8a7a04a96a7ce93e489e09fac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:27:12.649007 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=10,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:13.270573 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=63,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:23.805410 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:23.806933 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:23.883413 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167eb2-609d-4a56-896a-8d3361a22f43 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:23.946053 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6351122de1824cdf901a0943f64a1b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:23.946628 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:23.947027 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:23.947315 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:23.949560 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:24.008728 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:24.010320 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:24.019509 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1456/2907] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:27:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:27:27.563216 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:27.563674 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:27.563775 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:27.582696 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] MFA Rules not processed for user `06c3bd6e24f248afa52f13a91c37f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 15:27:27.583928 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:27.640417 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1452/2908] 10.222.0.45 () {58 vars in 967 bytes} [Thu May 26 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 15:27:27.686798 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:27.688408 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:27.728688 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:27.760859 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1c70b-b683-4562-9797-ab591dd4a801 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:27.766182 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '853a5aefa1dc493b9d1b222d3de15156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:27.766849 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:27.767153 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:27.767434 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:27.776592 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:27.778157 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:27.786861 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1457/2909] 10.222.0.45 () {60 vars in 1384 bytes} [Thu May 26 15:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 15:27:28.121218 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:28.122642 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:28.179952 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b631-8ae7-4e5d-a749-4426649bb12a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:28.183537 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae41b54b0504beb90cbd3da87c8f852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:28.184188 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:28.184536 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:28.184820 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:28.186610 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:28.249062 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:28.250513 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:28.260935 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1453/2910] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:27:34.253549 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:34.255155 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:34.271106 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f8ce-9cc6-49ac-b501-1a0bcd222f51 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:34.276104 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:34.277052 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:34.277405 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:34.277691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] PATH_INFO: `/v3/users/d836530b3a0c47d287c57ae3915d4371` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:34.278891 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d836530b3a0c47d287c57ae3915d4371)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:34.280883 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:34.327426 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd836530b3a0c47d287c57ae3915d4371'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.328085 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd836530b3a0c47d287c57ae3915d4371'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.336454 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd836530b3a0c47d287c57ae3915d4371'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.337122 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd836530b3a0c47d287c57ae3915d4371'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.344722 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd836530b3a0c47d287c57ae3915d4371'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.364124 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1458/2911] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:27:34 2022] DELETE /identity/v3/users/d836530b3a0c47d287c57ae3915d4371 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:27:34.531272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:34.542148 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e62e-ed24-4b96-b542-6c92affa13c6 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:34.593854 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:34.601404 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:34.602272 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:34.602562 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:34.602852 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] PATH_INFO: `/v3/projects/96bf20387ac24af6b192f071460b9056` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:34.604109 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bf20387ac24af6b192f071460b9056)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:34.606030 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:34.653833 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bf20387ac24af6b192f071460b9056', 'request_id': 'req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.659959 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bf20387ac24af6b192f071460b9056', 'request_id': 'req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.665595 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bf20387ac24af6b192f071460b9056', 'request_id': 'req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.678265 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] The token cache is being invalidate because project 96bf20387ac24af6b192f071460b9056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:27:34.678564 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.679219 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.680788 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1454/2912] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:27:34 2022] DELETE /identity/v3/projects/96bf20387ac24af6b192f071460b9056 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:27:34.684930 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:34.686390 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:34.699931 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66094840-d86c-4a39-bc80-c35cb2739f3d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:34.755886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:34.756757 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:34.757036 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:34.757311 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] PATH_INFO: `/v3/users/30e8ceaeee94430dad58ead15a0fc934` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:34.758474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e8ceaeee94430dad58ead15a0fc934)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:34.760544 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:34.801887 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:34.808501 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e8ceaeee94430dad58ead15a0fc934'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.809219 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e8ceaeee94430dad58ead15a0fc934'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.816934 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e8ceaeee94430dad58ead15a0fc934'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.817562 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e8ceaeee94430dad58ead15a0fc934'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.824789 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e8ceaeee94430dad58ead15a0fc934'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:34.843609 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1459/2913] 10.222.0.45 () {58 vars in 1223 bytes} [Thu May 26 15:27:34 2022] DELETE /identity/v3/users/30e8ceaeee94430dad58ead15a0fc934 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 15:27:35.024111 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:35.025567 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:35.039333 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ec181-0f5d-4a5f-94c6-84ecb83f3a9e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:35.097921 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc1f206a7534d478df8987147a33502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e013887c316445b783792ef3f307427d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:35.098786 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:35.099113 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:35.099409 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] PATH_INFO: `/v3/projects/53b1a63b30224e859b4adadd17c70715` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:35.100602 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b1a63b30224e859b4adadd17c70715)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:35.102520 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:35.150747 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b1a63b30224e859b4adadd17c70715', 'request_id': 'req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:35.157303 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b1a63b30224e859b4adadd17c70715', 'request_id': 'req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:35.163015 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b1a63b30224e859b4adadd17c70715', 'request_id': 'req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:35.176170 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] The token cache is being invalidate because project 53b1a63b30224e859b4adadd17c70715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 15:27:35.176533 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:35.177263 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 15:27:35.178823 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1455/2914] 10.222.0.45 () {58 vars in 1232 bytes} [Thu May 26 15:27:35 2022] DELETE /identity/v3/projects/53b1a63b30224e859b4adadd17c70715 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 15:27:44.840076 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:45.172606 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:46.839271 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:27:46.840691 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:46.912246 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb7aa-77d6-496b-96b6-86c6616c971d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:27:46.973209 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:27:46.973886 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:27:46.974152 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:27:46.974430 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:27:46.976259 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:27:46.987469 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:27:46.989078 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54838150-a53b-4027-a3c1-12b7296f59e7 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:27:46.999474 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1460/2915] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:27:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:27:56.995185 dv-cinder-843018-3-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=58 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:32:51.886077 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 15:32:51.887528 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 15:32:51.984865 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05ceb3-ee6e-40d9-bdbc-6c32755be5e3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 15:32:51.990857 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6fac7-46a5-4622-95cb-7f0f23aeb3cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5581ec9275db47fa96f784326ec51e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ca42592fd64c7a939af861dd81ed84', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 15:32:51.991659 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6fac7-46a5-4622-95cb-7f0f23aeb3cd service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 15:32:51.991989 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6fac7-46a5-4622-95cb-7f0f23aeb3cd service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 15:32:51.992337 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6fac7-46a5-4622-95cb-7f0f23aeb3cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 15:32:52.005396 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6fac7-46a5-4622-95cb-7f0f23aeb3cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 15:32:52.008394 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6fac7-46a5-4622-95cb-7f0f23aeb3cd service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 15:32:52.022585 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1456/2916] 10.222.0.45 () {60 vars in 1365 bytes} [Thu May 26 15:32:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 15:33:02.017481 dv-cinder-843018-3-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=37 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}